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A system and method are 
described for synchronizing (22, 23, 
24) store-and-forward networks (2, 3, 
4) and for scheduling and transmitting 
(11, 12, 13) continuous, periodic, 
predictable, time-sensitive, or urgent 
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and high-priority messages over those 
networks (2, 3, 4). This enables packet-, 
cell-, and/or frame-based networks 
(2, 3, 4) to thereby efficiently switch 
voice, video, streaming, and other 
real-time or high-priority data at the 
layer one or physical level (44, 150, 
77), thus ensuring that the delivery 
of selected information can be made 
fast, on-time, immediate, non-blocked, 
non-congested, loss-less, jitter- free, 
and have guaranteed delivery, and 
guaranteed quality of service. 
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LAYER ONE SWITCHING IN A PACKET, 
CELL, OR FRAME-BASED NETWORK 



Cross-Reference To Related Applications 
5 This application relates to United States Patent and Trademark Office 

i i 

Disclosure Document No. 431 129, entitled "Fast, Guaranteed, On-Time Delivery of 

•r 

Real-Time Streaming Data in a Packej Switching Network", which was filed in the 
United States Patent Office on February 9, 1998, the disclosure of which is hereby 
incorporated by reference. 
10 This application claims the benefit of U.S. Provisional Patent Application No. 

60/097,138, filed August 19, 1998. 



Field of the Invention I 

The present invention relates injgeneral to network communications switching, 

15 and more particularly to synchronizing store-and-forward networks and scheduling 

■j hi 

real-time or high-priority network transmissions for immediate and direct layer one or • 
physical level switching. 



Background of the Invention j 

f 1 ■ 

20 Current applications are consuming network bandwidth at exponentially 

| i . 

increasing rates. Current packet-switching, cell-switching, frame-switching, and other 
store-and-forward communication networks were designed to provide high-efficiency 
routing and switching capability for bursty, non-periodic, non-predictable, non-time- 



sensitive data traffic. However, when 



attempting to deliver continuous, periodic, 
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predictable, time-sensitive, or urgent information, the store-and-forward style 

i 

architectures are by their nature, ill-suited to efficiently perform the task. This is 
because store-and-forward style architectures, by their innate design, first store data, 

then examine it for addressing and priority, then switch and route it based on priority, 

i 

5 then store the data again in various priority queues, and then transmit it to the next 

| 

switch to repeat the process. These steps are subject to varying slowdowns and delays 
based on continuously varying, unpredictable network congestion. On the other hand, 
by its very different nature, continuous, periodic, predictable, time-sensitive, and high- 
priority information requires immediate switch-through with no delays. Thus, the 

i I 

0 characteristics which make store-and-forward switching so efficient for bursty, non- 
periodic, non-predictable, non-time-sensitiye data, are the exact opposite of what is 
needed for continuous, periodic, predictable, time-sensitive, or high-priority 
information. 

f 

As a result of this dilemma, various Jcomplicated schemes have been devised in 

; t 

5 an attempt to compensate for and circumvent these underlying store-and-forward 

i j 

network characteristics. Examples of these schemes include, but are not limited to 

! 
I 

prioritization schemes, priority queuing mechanisms, constant and variable bit rates, 
guaranteed and peak bit rates, layer three switching, guaranteed throughput, faster 
routing, Gigabit routing, switch routing, etc. Yet each of these attempts to circumvent 
0 the store-and-forward dilemma still remains built upon the fundamental store-and- 
forward architecture and switching. The result of these attempts to resolve the 

; i ; 

problem is a combination of solutions with complicated protocols, complex 

' ' I' 

implementation schemes, and/or inefficient; use of network resources. 



II' 
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i 

The explosion of bursty, non-periodic, non-predictable, non-time-sensitive data 

traffic coupled with converging high-bandwidth, real-time applications over these 

.1 

store-and -forward style packet-, cell-! and frame-based networks inevitably results in 
network congestion, delays, inconsistent delivery, jitter, packet loss, quality of service 
5 degradation, and/or inefficient networks. The applications most noticeably affected 

i 

will be real-time applications and high-priority information- 
Real-time applications are defined as applications where the end user 

j i 

experiences the information in real-time as it flows over the network. Examples of real- 

t ; 

time applications are telephony, Internet phone, packet phone video conferencing, 

i : 

1 0 video streaming, audio streaming, broadcast, multicast, and any other multimedia 

streaming applications. Real-time applications may be periodic, predictable, or time- 
sensitive. 

High-priority information is defined as information that must be delivered more 

! 

quickly, more reliably, more accurately, and ahead of other lower-priority information 
1 5 in the network. Examples of high-priority information include, but are not limited to 
emergency messages, time-sensitive or time-dependent information, network control 
messages,\ guaranteed delivery messages, or any other information deemed more 
lrnponam or more urgent for various reasons. 

Real-time applications and high-priority information are dependent upon the 
20 rapid, consistent, on-time, non-blocked, non-delayed, non-congested, loss-less, jitter- 
free, reliable flow of data in real-time. With real-time applications and high-priority 
information, poor network performance resulting in time delays and quality loss can 
drastically degrade the quality of the end user experience and the value of the service. 
At the same time, network operators and administrators would like to avoid network 
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complexities and inefficiencies in delivering real-time applications and high-priority 

i 

information. These delays, degradation, inefficiencies, and complexities are what this 

i 

invention seeks to overcome. ! 

. i 

Several factors can cause real-time applications such as Internet phone, Internet 

: I 
• t 

Video phone, Internet Video Conferencing, Internet Streaming Audio, Internet 

: [ 

Streaming Video, and other real-time multimedia applications to suffer in both quality 

i i 

and time delays over packet, cell, or frame^oriented store-and-forward networks." 
Among them are: 

• Packet, cell, and frame discard diie|to a congested switch, which in turn results 

in dropout glitches (poor quality) a'nd/or increased delay time to retransmit 

i 

missing packets, cells, or frames. \ I 

i 
i 

■ I 

• Packet loss due to alternate routing, which in turn results in dropout glitches 

. I 

(poor quality) and increased processing time to recover from and reconstruct 
missing packets. 1 ! 

• Waiting for alternate path packets (o arrive, resulting in time delays. 

• Reordering of packets that arrive out-of-order, resulting in time delays. 

• Higher layer processing (layers 2-4) of packets at each router before routing 

i 

the packets on to the next destination, resulting in time delays. 



Loaded/congested networks which 



slow down packet, cell, or frame delivery, 



resulting in random, non-predictable time delays 



Some combination or all of these problems are innate in packet, cell, and frame- 
oriented networks, their architectures, switches, and protocols. This includes older 
systems as well as the newer standards like TCP/IP version 6, Frame Relay, and ATM. 
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Newer protocols and systems such as Resource Reservation Protocol (RSVP), Bit 

Stream Reservation Techniques, layertwo Switching, layer three Switching, Cut- 

j ' - 
though switching, Flow Switching and other techniques have been designed in an 

i 

attempt to reduce these problems for real-time or high-priority information. However, 
5 none of these efforts have been able to completely eliminate a fundamental 

architectural tenet of packet, cell, and jframe-based switching in store-and-forward 
networks - i.e., when network buffers get overloaded, these systems must drop 
packets and slow down to "decongestl" This can affect and slow down real-time 

applications and high-priority information. For example, in some of these efforts, once 

j 

10 a real-time packet is in the input buffer, it can be routed through even a congested 
switch with a higher priority. However, if the input buffers are full, the real-time 

application may not be able to get its packet in to be recognized as a high-priority 

I 

packet. On the other hand, efforts to overcome this problem by reserving capacity on 

I ■ 

the switch means the switch will, in effect, limit its input or throughput to reserve 

i 

1 5 capacity for guaranteed applications, thus resulting in inefficiencies in the switch. 

i 

Streaming broadcast or multicast audio and video applications deal with these 

j : 

store-and-forward effects by having large buffers and error correction at the receiving 

i i 
i 

end (client) to compensate for the uncontrollable delays and losses. 1-iowevei, the 
large buffers result in long start-time delays for both audio and video "broadcast-style" 
20 streaming applications. The end user must wait while the buffers fill with the initial 
incoming packets before he/she can see. or hear the program. 

Internet Phone, Internet Video Phone, and Internet Video Conferencing 

applications must reduce the size of tliese buffers to minimize the awkward delay time 

i 

between end-users. They also use compression algorithms to reduce network 

I 
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congestion. Unfortunately, neither of these techniques is sufficient, since network 
overload and congestion will still cause packet discarding, slowdown, and jitter, 
enough to cause awkward pauses between Jend-users. The resulting conversation is 

similar to the delayed satellite conversations that are sometimes encountered in 

i i 

overseas calls. As mentioned previously, techniques to solve these problems, such as 
guaranteed constant bit rate or guaranteed peak bit rate, either introduce their own 

i 

inefficiencies or don't really guarantee the results one hundred percent of the time. 

i 

Newer networks are proposing to switch at very high gigabit speeds to minimize 
the delay times for real-time applications such as telephony. Nevertheless, as more 



high-bandwidth applications like telephony, 



web graphics, and streaming video get 



i 

dumped into these gigabit networks, they too, will either be designed to be inefficient, 

* [ 

or will get congested and slow down with the resulting degradation of speed and 
quality. , j 

i 

Clearly, there is a need for a way to: 

• guarantee delivery of selected packets, such as real-time and high-priority 
packets, like Internet phone, audio and video streaming, video conferencing, 
and urgent messages. ; j 

! 

I 

• assure that selected packets, such as|real-time and high-priority packets, arrive 

on time so that large buffers, long start delays, and awkward pauses are 

i 

reduced or eliminated. I 

! 
j 

I 

• assure that selected packets with higher priority will be delivered more rapidly 
through the network than lower-priority packets. 

• overcome or bypass the packet networks' innate characteristic of slowing down 



the delivery of specific packets when 



the network gets loaded or congested. 
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• i 



specific scheduled packets are then transmitted into one end of the network where they 
propagate directly through all of the layer one switches on the path to the other end of 
the network, with no delays other than transmission line and layer one switch 

i 

i 

propagation delays. In this way, they completely bypass the store-and-forward 
network with all of its inherent disadvantages for continuous, periodic, predictable, 
time-sensitive, or high-priority information.. Once the packets have been sent all the 

way through the network and the scheduled layer one event is over, the devices switch 

i 

■ i 

back to standard store-and-forward switching for bursty, non-periodic, non- 
predictable, non-time-sensitive, and non-high-priority information. In this way, the 
system works to optimum advantage and efficiency for each of the two types of data 

i 

and switching methods. j 

The network architecture itself consists of means for a master clock; time 

I 

synchronization receiver means for synchronizing a clock on each network element; a 

I 

source, which is a network element, also variously termed an originator or a caller; a 
departure router, which is a network element, also variously termed a departure 
switch, a departure node, or an originating edge node; mid-destination routers, which 
are network elements, also variously termed mid-destination switches, internal nodes, 

or middle nodes; a final destination router, which is a network element, also variously 

j 

termed a final-destination switch, or terminating edge node; a receiver which is a 
network element, also termed a called party; and transmission paths connecting the 

i 
| 

network elements. ] j 

The architecture is such that a master! clock synchronizes the device 
embodiments using receiving synchronization means. In the preferred embodiment, the 
master clock comprises the combined maste'r clocks on the satellite Global Positioning 
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• do the above tasks with a high degree of network efficiency. 

Summary of the Invention 

The foregoing problems are solved and a technical advance is achieved in 
5 accordance with the principles of this j invention as disclosed in several structural 

embodiments of switching devices, methods, and network architectures. These device 
embodiments, methods, and network architectures utilize means for a master clock; 
means for synchronization of clocks inldistributed network elements; means for 

! 

switching within each network element in a non-blocking, non-delaying manner at a 

i : 

10 layer one level; means for scheduling and executing high-priority, real-time, or other 

layer one calls or sessions in each network element; means for controlling said 

I 

synchronization means, said switching means, and said scheduling and execution means 

! ! 
I i 

in each network element; and the resulting system or network architecture wherein all 
layer one network element inputs and outputs on a given path switch their packets, 
1 5 cells, or frames in a cut-through manner bypassing the entire network at a layer one or 
physical level at the correct scheduled time with minimal or no store-and-forward 
delays. 

More simply put, all of the siore-and-iorward device embodiments in the 

I 

network are synchronized. Then a source or destination sets up a reservation schedule 

20 with all of the network devices for transmitting real-time or high-priority packets. At 

i ; 

the specific predetermined scheduled time, all of the devices on the scheduled path 
through the network switch the appropriate input and output lines to bypass their 

standard store-and-forward switches and switch open a direct non-blocking, non- 

I 

delaying layer one physical connection from one end of the network to the other. The 
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System (GPS) commonly used today for timing and positioning measurements. GPS 
enables synchronization of device embodiment clocks down to the microsecond and 
nanosecond range. Descriptions of GPS timing techniques and the accuracies 
obtainable are covered in "Tom Logsdon's "Understanding the Navstar: GPS, GIS, 
5 and IVHS"; 2 nd edition; 1995; VanNostrand Reinhold; Ch. 1 1; pp. 15 8- 174 which is 
hereby incorporated by reference. 

Detailed descriptions of GPS, synchronization techniques, time codes, clock 
measurements, accuracies, stabilities, a nd other useful applications of GPS technology 
are covered in literature from the company TrueTime, Inc, 2835 Duke Court, Santa 
10 Rosa, California 95407, including Application Note #7, "Affordable Cesium 

i . 

Accuracy"; Application Note #11, "Video Time and Message Insertion"; Application 
Note #12, "Multi User Computer Time Synchronization"; Application Note #14, 

"Model GPS-DC Mk III Oscillator Selection Guide"; Application Note #19, 

i 

"Simplified Frequency Measurement System"; Application Note #20, "Achieving 
15 Optimal Results with High Performance GPS"; Application Note #21, "Model XL-DC 
in Frequency Control Applications"; Application Note #22, "TrueTime 1 s GPS 

i 

! ; 

Disciplined Cesium Oscillator Option"; Application Note #23, "Precise 

i 

Synchronization of Computer Networks: Network Time Protocol (NTP) ior TCP/IP", 

i ■ 

Application Note #24, "Precision Time and Frequency using GPS: A Tutorial"; 
20 Application Note #25, "Precise Synchronization of Telecommunication Networks"; 
and Application Note #26, "Real Time Modeling of Oscillator Aging and 
Environmental Effects". These application notes are available from TrueTime and are 
hereby incorporated by reference. 
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In addition, two-way transfer time synchronization methods may be used, 

i 

including techniques similar to those described in "Two-way Satellite Time Transfer"; 

published by the U.S. Naval Observatory oh their website at 

i 

i 

http://tycho.usno.naw.mil/twowav.html which is hereby incorporated by reference. 

Nevertheless, the present invention is not limited to GPS for either the master 
clock means nor for the device embodiment synchronization means. Any reasonably 
accurate clock may serve as the master clock including, but not limited to atomic* 
clocks, cesium, rubidium, hydrogen maser clocks, or even quartz clocks; also any 
satellite-based clock, for example, GPS, transit navigational satellites, GOES satellites; 
any wireless clock, for example LORAN, TV, WWVB radio, radio phone, local radio; 
any land-based clock using physical interconnections such as copper wire, cable, 
microwave, or fiber, such as the central office clocks used currently by the 

telecommunications providers for synchronizing their synchronous networks; or even 

: j 

sea-based clocks will work as a master clock for the purposes of the present invention. 

' | 

In the same way, any time synchronization techniques for synchronizing the 
device embodiments with a master clock and with each other may be used, such as 
those explained in the Logsdon reference, for example absolute time synchronization, 
clock fly-overs, common-view mode, and multi-satellite common view mode; those 

: I 

explained in the TrueTime reference, such jajs Network Transfer Protocol (NTP); those 

explained in the U.S. Naval Observatory web publication reference, such as two-way 

I 

time transfer; and various other techniques in use today such as the 

i i 

telecommunications synchronous networklsystem used in central offices and other 
higher level switching centers today. 
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Once a reasonably accurate time synchronization has been established in the 

j 

device embodiments, well known techniques such as two-way time synchronization, 

! 

common-view mode, or multi-satellite common view mode can then be used between 

i 

i , 

the device embodiments in the network to measure and correct, to a high degree of 

i 1 

5 accuracy, slight timing disparities andj propagation delays between themselves and 

i ' 

adjoining device embodiments. This serves to maintaining and further tighten timing 
synchronization. 

As the device embodiments are synchronized in the network, each device 

i 

initiates its own layer one event scheduling process. This process includes building a 

j 

10 layer one event schedule which thus enables the establishment of reservations for 

specific times or for periodic (repeating) times for each input and output line on each 
network element device embodiment. In this way, packets may be scheduled to be sent 
from specific input lines through the non-blocking, non-delaying layer one switch to 
specific output lines in each network element device embodiment. 

15 At this point, a real-time source,! a real-time destination, or another network 

element device embodiment can initiate a layer one call setup process for any purpose, 

i 

such as a real-time application or high-priority message. This process establishes a 

i . 

specific lime or periodic (repeating) lime schedule in each oi ihe synchronized iayei 
one network device element embodiments along a specific path from the source 
20 through the synchronized network to the destination. At the scheduled time, each 

i ' 

synchronized layer one network element device node embodiment along that path 
switches their appropriate input and output lines to bypass the normal store-and- 

! 

forward buffering and switching, and route directly from the input lines through a non- 
blocking, non-delaying layer one switch and directly on through the output lines to the 



BNSDOCID: -;WO 001 1838A1_I_> 



WO 00/11838 1 2 PCT/US99/18500 

i 

next synchronized network element device jnode which is synchronized and scheduled 
to do the same thing. In this way, at any scheduled instant, a packet may be sent in a 
cut-through manner directly from the source through the network to the destination 
with only the propagation delay of the transmission lines, the input and output bypass 
circuitry, and the layer one circuitry. This obtains the goal of a rapid, consistent, 
immediate, on-time, non-blocked, non-delayed, non-congested, loss-less, jitter-free 

; i 

reliable flow of data in real-time, with guaranteed delivery and guaranteed quality of 

I 

i 

service. ! i 

i 

The network element device embodiments comprise input and output switching 

■ i 

means; input and output buffer means; controlling means; non-blocking, non-delaying 

• t 

■ s 

layer one switching means; and optionally; a packet-oriented, cell-oriented, frame- 

' I 

oriented, or other store-and-forward switching means. 

, i 

; i 

The first network element device embodiment is the preferred embodiment in 

: i 

which a standard packet, cell, or frame-oriented switching means is both included and 
integrated into the device embodiment, such that these device embodiments are 

i 

deployed in standard packet, cell, or frame-briented networks. In this scenario, the 

device embodiments normally operate in packet, cell, or frame-oriented mode using the 

. | 

packet, cell, or frame-oriented switch. However the device embodiments are then used 

i 

i 

to schedule and switch real-time and high-priority packets to cut-through and bypass 

the packet, cell, or frame-oriented switched, network at the scheduled times. The 

i 

control circuitry in these preferred device embodiments enables complete integration 

into existing packet, cell, or frame-oriented 'networks, including the capability to store 

j 

and hold non-real-time and non-high-priority in-transit packets in buffers while the 

i 

, layer one switching occurs, and then resume sending the non-real-time and non-high- 
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priority in-transit packets once the layei; one switching is terminated. The control 

] 

circuitry in these preferred device embodiments enables scheduled layer one switching 

from specific input lines to specific output lines through the non-blocking, non- 

j ■ 

delaying switch, while at the same time routing in normal packet, cell, or frame mode 
5 through the packet, cell, or frame switch for input and output lines that are not 

| ; 

scheduled for layer one switching. 

The second network element device embodiment is similar to the first network 
device embodiment, except that the standard packet, cell, or frame-oriented switching 
means is not integrated into the device embodiment as one complete integrated unit. 

! ! 

10 Instead, the packet, cell, or frame-oriented switch is physically distinct, and the layer 
one network element device embodiment is "overlaid" or placed around the existing 
packet, cell, or frame-oriented switch.; In this way, all external input and output lines 
going to and from the network route first through the second network element device 
embodiment and then are connected to the physically separate store-and-forward 

1 5 switch. The primary purpose of the second device embodiment is to enable the r 

installation of layer one switching on top of existing store-and-forward switches in an 

j 

existing network, to eliminate the costs of replacing the existing packet, cell, or frame- 
based switches. • ! . 

As in the first device embodiment, the second device embodiment operates 
20 normally by switching standard store-and-forward packets through to the separate and 

i 
t 

distinct packet, cell, or frame-oriented switch. Like the first device embodiment, the 
second device embodiment also uses its layer one switch and control circuitry to 
schedule and switch real-time and high-priority packets to cut-through and bypass the 
store-and-forward network at the scheduled times. However, in this device 
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embodiment, the control circuitry is not integrated into the packet, cell, or frame- 
oriented switch. Consequently, there is the capability to stop, store, and hold standard 
packets in the input buffers when there is a : layer one switching conflict. Hovyever, 
because of the physically separate store-and-forward switch, there is no control 
capability to force the store-and-forward switch to stop, store, and hold standard 
packets while the layer one switching occurs through the output stage, and then 
resume sending the standard packets wheh!the layer one switching is terminated. ' 
Instead, the layer one circuitry in the secorid device embodiment is modified so that the 

output from the store-and-forward switch automatically routes to an output buffer 

i 

which it can control, such that no layer brie collisions will occur in the output circuitry 
as well. j 

In a third device embodiment of the invention (not shown in the drawings as it 
merely deletes functionality from the second device embodiment), the costs and 
functionality of the second device embodiment of the invention are reduced even 
further, by "dummying it down," such that the input buffers are eliminated entirely 

from the third device embodiment. The primary purpose of the third device 

; i 

embodiment is to lower the layer one switching costs such that installation of layer one 
switching on top of existing store-and-forward switches in an existing network is very 
cost-compelling. 1 < 

As in the second device embodiment 1 , the third device embodiment operates 
normally by switching standard store-and-forward packets through to the separate and 
distinct packet, cell, or frame-oriented switch. Like the second device embodiment, 
the third device embodiment also uses its layer one switch and control circuitry to 
schedule and switch real-time and high-priority packets to cut-through and bypass the 
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i 

store-and-forward network at the scheduled times. However, as in the second device 

i ■ 

embodiment, there is no control circuitry integrated into the packet, cell, or frame- 

i ■ 

oriented switch and there are no input buffers. Consequently, there is no capability to 
stop, store, and hold standard packets' in the input stage when there is a layer one 
switching conflict. Instead, the layer one control circuitry in this third device 

embodiment theoretically may interrupt standard incoming store-and-forward packets 

I 

in order to execute scheduled layer one, switching from specific input lines to specific 
output lines. Should this theoretical interruption occur, a standard packet may be lost. 
If loss of the packet would occur, it would likely be re-sent through its normal 
protocol flow control. In actual practice, however, if the clock timing of the third 

i ■ 

device embodiment is closely synchronized to the layer one device that is transmitting 
the layer one packets, the likely event jis that very few bits would be lost on the 
preceding, incoming standard packet. J In fact, if any bits were lost on the incoming 
line, they would most likely be the trailing flag bits, frame delimiter bits, or 
synchronization bits, from the preceding standard packet. As long as the end of frame, 

i 

packet, or cell is recognized by the infjmt circuitry of the separate store-and-forward 

switch, the devices will function normally. As stated previously, should any loss of 

i 

standard packets, cells, or frames occur, in most cases ihe protocols wouid re-transmit 
the missing data. j 

In a fourth device embodiment of the invention (not shown in the drawings as it 
merely deletes functionality from the second device embodiment), the costs and 
functionality of the third device embodiment of the invention are reduced even further, 
by "dummying it way down", such that the input and output buffers are eliminated 
entirely from the fourth device embodiment. The primary purpose of the fourth device 
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embodiment is to significantly lower the layer one switching costs such that installation 
of layer one switching on top of existing store-and-fonvard switches in an existing 
network is extremely cost-compelling. \ \ • 

As in the third device embodiment,; the fourth device embodiment operates 

i 

5 normally by switching standard store-and-fprward packets through to the separate and 
distinct packet, cell, or frame-oriented switch. Like the third device embodiment, the 

fourth device embodiment also uses its layer one switch and control circuitry to ' 

i 

schedule and switch real-time and high-priority packets to cut-through and bypass the 

i 

store-and-forward network at the scheduled times. However, as in the third device 
10 embodiment, there is no control circuitry integrated into the packet, cell, or frame- 
oriented switch and there are no input or output buffers. Consequently, there is no 

i 

capability to stop, store, and hold standard packets in the input or output stages when 

i 

there is a layer one switching conflict. Instead, the layer one control circuitry in this 

! 

fourth device embodiment in practice will possibly interrupt standard incoming store- 
1 5 and-forward packets and will likely interrupt standard outgoing store-and-forward 
packets in order to execute scheduled layer jone switching from specific input lines to 
specific output lines. When this practical interruption occurs, a standard packet will 
likely be lost. If loss of the packet occurs, it would also likely be re-sent through its 
normal protocol flow control. The fourth embodiment is not recommended but could 

i 

20 be used to implement very inexpensive layer one devices on top of existing store-and- 
forward networks, where highly cost-effective real-time or high-priority switching is 

desired at the understood expense of retransmitting the standard bursty, non-periodic, 

i 

non-time-sensitive, lower priority store-and-forward traffic. 

t 

: t i 

i 
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i 

The fifth device embodiment consists of placing the same device elements in the 
Source and/or Destination device, such that the Source and/or Destination device 
outside of the network edge node is also outfitted with a master clock synchronization 
means, controlling means, input and output bypass switching and buffering means, 
normal packet, cell, or frame input and output circuitry means, and real-time (layer 
one) input and output circuitry means, j ■ 

The sixth device embodiment is an extension of the fifth device embodiment, in 

i . 

! 

that the layer one end-user fiinctionalitymay be adapted to a Local Area Network 

(LAN) such as Ethernet or Token Ring by using the fifth device embodiment or "end- 

i " 

user" embodiment as the LAN controller; LAN bridge and/or LAN router, and either 
using the master clock and timing synchronization means to synchronize each LAN- 
attached device directly or having each! LAN-attached device synchronize off of the 

j 

synchronized clock on the LAN controller, bridge, and/or router. Modifying the 
software such that (a) all the LAN-attached devices have synchronized clocks, (b) each 

LAN-attached device keeps track of the other LAN-attached devices' scheduled times, 

! 
i 

and (c) all LAN-attached devices do not attempt normal LAN operation when a layer 
one event is scheduled for another LAN-attached device, thus enables each device on 

the LAN to send and receive layer one; packets directly and siili keep normal LAN 

j ' 

operation when layer one events are not 1 scheduled. Each LAN-attached device can 

! ! . 

then send a layer one call setup message requesting a layer one scheduled time. Each 

| ■ 

network element on the layer one patlrwould attempt to set up the call or session as 
with any other layer one setup. This would not require a need to modify the basic 
protocol. In effect, the basic protocol would be suspended for the layer one scheduled 
time. In this way, applications like Internet phone could send and receive scheduled 
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layer one packets through the bridge or router, and out into any layer one network to 

i 
I 

any layer one connected destination. This approach would also work on intranets so 
that calls could be made within the LAN or intranet itself. 

The seventh device embodiment does not include a standard packet, cell, or 
frame-oriented switching means, such that these device embodiments only switch 
packets in an entirely and exclusively layer one scheduled network. 

The layer one Event Scheduling process comprises a layer one Call Setup 
Process, a layer one Switching Process, a layer one Inter-Node Call Setup Process, and 
a layer one Call TearDown Process. The layer one Call Setup Process schedules a 
layer one Event along a path of layer one device embodiments through a layer one 

network. The layer one Switching process switches the layer one packets through the 

i 

layer one network at the scheduled times, j The layer one Inter-Node Call Setup 
Process establishes calls between layer one device embodiments in the network for 
purposes of time synchronization, rapid call, setups, emergencies, administration, etc. 

The layer one TearDown Process terminates layer one calls and frees up the layer one 

I 

Scheduling process for other layer one callsL 

j 

Further, the layer one Event Scheduling Process has various Reject Mode 
handling capabilities that it can implement if it cannot successfully set up a call. Some 
examples of Reject Mode include sending a Reject Message back to the previous node 



the node device embodiment to try an 
scheduled time that fits into the original 



thereby canceling setup of the call; enabling 
alternate route; or determining the next best 
parameters on the Call Setup Request. 

Finally, the process by which the layer one switching system works is achieved 
in the following steps: 
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Step 1 - All routers set their clpcks to exactly the same time, within some 
extremely small acceptable tolerance so that small variations are insignificant compared 
to the bit rate of the routers and transmission systems. Once the clocks are 
synchronized, all routers then measure or compute the approximate transmission delay 
times between themselves and their adjacent routers, as explained later. 

Step 2 - Real-time or high-priority Source 1 sends a call setup message to 
Departure Router 2 indicating that it vyants to set up a real-time or high-priority layer 
one transmission to real-time or high-priority Receiver 5. This message may notify the 
Departure Router 2 that this is the first of a long stream of packets whose delivery is 

time-dependent and should not be subject to router, buffer, multiple paths, or other 

I 

packet network delays. Included in this notification should be a minimum of the 
requested bit rate for the data and the requested periodicity. 

Step 3 - Departure Router 2 looks at the intended destination and requested 
data rate in the call setup message. Just as it does in standard packet switching, it 
determines that the next router is Mid-ldestination Router 3 and the transmission path is 
Transmission Path 12, Departure Router 2 then looks at Transmission Path 12's data 
rate and compares it to the requested data rate from real-time or high-priority Source 
]. Depanuie kouiei 2 then determines how frequently ana tor what duration n should 

send packets of data from real-time orj high-priority Source 1 over Transmission Path 

I 

12 to Mid-destination Router 3. This determination is based upon data rates and pre- 

■ ! ■ 

existing layer one schedules/reservations that may already be in existence. Based upon 
this determination, Departure Router 2 reserves exact times and durations for it to 

! 
I 

send information over Transmission Path 12 to Mid-destination Router 3. It then 

j 

sends a call setup message to Mid-destination Router 3 telling it that it is requesting to 
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reserve/schedule a real-time or high-priority transmission, along with the appropriate 
source address, destination address, its preferred departure times and duration time 
from Departure Router 2, and its estimatedi arrival times at Mid-destination Router 3. 

Step 4 - The Mid-destination Router 3 receives the call setup message from 
Departure Router 2. Router 3 looks at thelsource, destination, and requested data 
rate. It determines that the next router is Final Destination Router 4 using 
Transmission Path 13. It then looks at its own schedule, the transmission delay times, 

the calculated arrival times and duration time of the data that is to come from 

i 

Departure Router 2. Mid-destination Router 3 then tries to schedule its physical-layer 

■ ! 

or layer one switching mechanism to effectively "hardwire" route the stream straight 
on through to the Final Destination Router If there is a scheduling conflict due to an 

: j 

existing schedule, Mid-destination Router 3 may use various Reject Modes to try to 

j 

accommodate the data by buffering and delaying it very slightly. If this can't be done 
with only a slight delay, Mid-Destination Router 3 may determine a 

, i 

reservation/schedule that works better for 'it. It reserves those times and 

i 

communicates back to Departure Router 2 its suggested changes to the original 

■ i 

schedule. It also may at this time notify Final Destination Router 4 what it is trying to 
do to determine what unreserved/unscheduled time Final Destination Router 4 might 
have available. This information is passed back to Departure Router 2. In this way the 
routers may negotiate an acceptable reservation/ schedule that works for all of them. 

• If no schedule is acceptable, then the Departure Router 2 notifies the real-time 
or high-priority Source 1 that it has been unable to set up a guaranteed real-time or 
high-priority layer one reservation. Real-time or high-priority Source 1 can then 
decide if it wants to: (a) use standard packet switching with all of the inherent delays, 
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j ( ■ 

(b) wait until the reservation/schedule' frees up from other sessions which will complete 

! 

and tear down their reservations/schedules soon, or (c) begin a standard packet 
switching session with the hope that a guaranteed real-time or high-priority 

reservation/schedule will become available during the session as other real-time or 

i 

i 

high-priority sessions are completed and torn down. In situation (c) a standard packet 
switching style session can be converted to a guaranteed on-time real-time or high- 
priority layer one session once the reservation/scheduling arrangements can be made, 

J 

even during the course of a session, ifj desired. 

Step 5 - Final Destination Router 4 repeats the process described in Step 4, 

communicating its reservation/schedule back to Departure Router 2 and Mid- 

j 

destination Router 3 until an acceptable reservation/schedule is set up between thern. 
Final Destination Router 4 then notifies the Real-time or high-priority Receiver 5 that a 
session is being established. In this way the Real-time or high-priority Receiver 5 gets 

ready to accept Real-time or high-priority data input. 

i 

Step 6 - Once the reservation/scheduling is agreed upon, Departure Router 2 

notifies real-time or high-priority Source 1 to start shipping data. Departure Router 2 

' j . 

then ships the data to Mid-destination Router 3 over Transmission Path 12 at exactly 
the agreed upon lime. Mici-destinaiion kouiei 3 is ready and waning ioi ine data ai 
exactly the calculated arrival time and "hardwire" layer one switches the data straight 
on through to Final Destination Route 4 over Transmission Path 13 at precisely the 
correct times. Final Destination Routje t 4 then "hardwire" layer one switches the data 
straight on through to the Real-time or high-priority Receiver 5 over Transmission 
Path 14. i t 
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I 

Step 7 - When the session has no more data to ship, for example, the streaming 
program is completed, or the phone call is "hung up", then the reservation/schedule for 
that session needs to be torn down. This event can be triggered by a TearDown 

! 

notification message from either of the endj routers to the routers along the path. Once 

i 

a router receives notification that the session is over, it tears down that session, 
wherein it frees up its reservation schedule; and reverts to standard packet network 
mode until another guaranteed real-time orj high-priority session is requested and 
negotiated, which starts the process all over again. 

It is accordingly an object of the present invention to guarantee high-quality, 
rapid, consistent, on-time, non-blocked, non-delayed, non-congestion-affected, loss- 
less, jitter-free, reliable delivery of packets in a packet network, for real-time, high- 
priority, and/or high-quality-of service applications that require it. It does this in the 
following ways: (a) It assures delivery of. the packets in order without being discarded 
or dropped as in normal packet, cell, or frame switching, (b) It delivers the packets on 
time by scheduling arrival times and departure times, (c) It reduces delays by skipping 

the queuing mechanisms in the routers. (d)!It eliminates the need for large buffers, 

i 

thereby reducing or eliminating long start delays and awkward pauses, (e) It reduces 

significantly or entirely eliminates jitter by delivering packets at known, predictable 

I 

times. I 

Thus the overall benefits of the invention are; 
• It establishes a means to deliver packets, cells, or frames over a packet 

switched network in a way that guaiantees that they will be delivered on-time 
and in time to be used by the receiving application. This means that packets 
won't be lost or arrive too late to be' used by the application. 
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i 

• It reduces the overall delay time for real-time applications such as voice, video, 

] 

J 

and other real-time multimedia delivery needs over a packet network. This will 
reduce or eliminate the noticeable "lag-time" for Internet Phone. It also will 
reduce or eliminate the delayed start times in "streaming" audio and video, 
5 because the receiver doesn't need to wait to fill its huge incoming buffer. 

• It can be used as a prioritization and advanced reservation scheme, thus 

| 

assuring high priority users that they can have the capacity needed at a 

particular time. ! 

i i 

• It solves the non-guaranteed, random, lossy degraded, and delayed response 

- i ■ ■ 

10 time problems of packet, cell, |and frame-based networks for real-time 

i ; ' 

applications, high-priority messages, and high-quality-of-service. 

• It works with standards based (protocols and networks, e.g., RIP, OSPF, 

i 

RSVP, ISA, IGMP (multicast), 'ATM, TCP/IP, Ethernet, Token Ring, X.25, 

i 

Frame Relay, SMDS. j - 

15 • It thus creates the capability for a Next Generation of routers and/or software. 



Brief Description of the Drawings 

Fig. 1 is a high-level functional block diagram of a certain environment and 

I 

components of a network system as disclosed in Disclosure Document No. 43 1 129, 

i 
i 

20 referenced previously. It shows a packet-switched network comprised of routers 

which are synchronized by a master clock, according to a preferred embodiment of the 

I 

network architecture according to the! present invention. 

i 

Fig. 2 is a redrawing of Fig. 1, done in a linear manner for easier visual 

! 

understanding, such that data clearly flows from left to right, i.e., from source to 
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destination, through the network system according to a preferred embodiment of the 
present invention. i 

Fig. 3 is a more detailed high-level functional block diagram Fig. 2, showing the 
bi-directionality or two-way nature of the network system according to a preferred 

embodiment of the present invention. i \ 

i 

Fig. 4 is a detailed high-level functional block diagram of the network, wherein 

I 

the first device embodiment, that of the preferred integrated device embodiment is 

i 

shown operating as the network elements. ! 

i 

Fig. 5 is a detailed high-level functional block diagram of the network, wherein 

i 

the second device embodiment, that of the! overlay device embodiment is shown 
operating as the network elements. j 

Fig. 6 is a detailed high-level functional block diagram of the network, wherein 

the fifth device embodiment, that of the source and destination device embodiment is 

: j 

shown operating as the source and destination. 

1 i 

Fig. 7 is a detailed high-level functional block diagram of the network, wherein 

' i 

the seventh device embodiment, that of the pure layer one device embodiment is shown 
operating as a network element. ! 

Fig. 8 is a more detailed high-level functional block diagram of a more complex 
network environment with the components of a layer one network system according to 
the present invention. Fig. 8 also shows two examples of the sixth device embodiment 
as layer one Local Area Network or LAN systems. 

Fig. 9 is a high level schematic diagram of a first embodiment and the preferred 

! 

embodiment of an integrated layer one network switch or router device according to 

i 

the present invention comprising master clock synchronization means, input, output, 
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control, and integrated store-and -forward switching means, and non-blocking, non- 

i 

delaying layer 1 switching means. | j 

i 

Fig. 10 is a high level schematicj diagram of a second embodiment, the "overlay" 

I [ 

embodiment of a layer one network switch or router device according to the present 

i 

5 invention comprising master clock synchronization means, input, output, control, and 

non-blocking, non-delaying layer 1 switching means, coupled to a physically separate 

I ■ 

store-and-forward switching means. 

Fig. 1 1 is a high level schematic diagram of a fifth embodiment, also termed the 

t 

"source and destination" embodiment |Or "end-user" embodiment of a layer one 

j 

10 network switch or router device according to the present invention comprising master 
clock synchronization means, input, output, control, with standard store-and-forward 

packet, cell, or frame-based input andjoutput handling means, and real-time or high 

j 

priority layer one input and output handling means. 

Fig. 12 is a high level schematic ^diagram of a seventh embodiment, the "pure 

| \ 

1 5 layer one" embodiment of a layer one network switch or router device according to the 
present invention comprising master clock synchronization means, input, output, 
control, and non-blocking, non-delaying layer 1 switching means, with no store-and- 

! 

forward switching means. j 

Fig. 13 is a detailed functional block diagram of a preferred embodiment of input 

! 
i 

20 means according to the present invention, including input switch means, input switch * 
array means, input switch control means, input buffer means, input buffer array means, 
and input buffer control means. 

Fig. 14 shows the Operational Process for Edge Input Circuitry, wherein the 

! 

process behind the operation of the input means shown in Fig. 13 is explained. 
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l 

. i 

Fig. 1 5 shows the Operational Process for Non-Edge or Internal Layer One 
Input Circuitry, wherein the process behind the operation of the input means shown in 
Fig. 13 is explained. ' ; 

Fig. 16 is a detailed schematic diagram of a preferred embodiment of input buffer 
means according to the present invention, including input switching means, input 
switching control means, input buffer bypass means, input buffer memory means, input 
interface handler means, address resolution means, input queue manager means, and 
input program memory means. 

Fig. 17 shows the Input Queue Manager Process, wherein the process behind the 

operation of the input buffer means shown in Fig. 16 is explained. 

i 

Fig. 18 is a detailed functional block diagram of a preferred embodiment of 
output means according to the present invention, including output switch means, 
output switch array means, output switch control means, output buffer means, output 

buffer array means, and output buffer contrbl means. 

■ i 

Fig. 19 and Fig.20 show the Operational Process for Edge Output Circuitry, 
wherein the process behind the operation of the output means shown in Fig. 18 is 

. ! 

explained. ! I 

Fig. 21 and Fig. 22 show the Operational Process for Non-Edge or Internal Layer 

One Output Circuitry, wherein the process behind the operation of the output means 

i 

: i 

shown in Fig. 1 8 is explained. | 

■ j 

Fig. 23 is a detailed schematic diagram of a preferred embodiment of output 

■ i 

buffer means according to the present invention, including output switching means, 
output switching control means, output buffer bypass means, output buffer memory 
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means, output interface handler means, address resolution means, output queue 

i 
I 

manager means, and output program memory means. 

■i 

Fig.24 shows the Output Queue Manager Process, wherein the process behind 

i . 

the operation of the output buffer means shown in Fig. 23 is explained. 
5 Fig.25 is a detailed functional block diagram of an illustrative embodiment of 

i 

non-blocking, non-delaying switching means according to the present invention, 
including input amplifying and limiting means, input matrix means, output matrix 
means, output switching means, output switching control means, and output means. 
Fig.26 is a detailed functional block diagram of an illustrative embodiment of 
10 non-blocking, non-delaying switching means according to the present invention, 
including input amplifying and limiting means, input matrix means, output matrix 
means, output switching means, output switching control means, and output means. 

Fig.27 is a detailed functional schematic diagram of an illustrative embodiment 

j . 

of a non-inverting amplifier circuit froni|the non-blocking, non-delaying switching 
1 5 means shown on Fig.25 and Fig.26 according to the present invention. 

Fig. 28 is a detailed schematic diagram of an illustrative embodiment of control 
means for selecting the output of the npn T b!ocking, non-delaying switching means 

according to ihe present invention. j 

i ■ 

Fig. 29 is a detailed schematic diagram of an illustrative embodiment of store- 
20 and-forward packet, cell, or frame switching means according to the present invention. 
Fig. 30 is a detailed schematic diagram of an illustrative embodiment of the 
controller means according to the present invention. 

Fig.31 is a detailed hardware diagram of an illustrative embodiment of the 

t 

controller means according to the present invention. 



BNSDOCID:<WO 0011838A1 l_> 



WO 00/11838 28 4 PCT/US99/18500 

Fig. 32 is a detailed functional and relational block diagram of the controller 
means according to the present invention. 1 i 

Fig.33 and Fig. 34 show the mastercontroller process used to operate the 

i 

controller shown in Fig. 30, Fig. 3 1 , and Fig[32. 

Fig,35 and Fig. 36 is a flowchart diagramming the layer one event scheduling 

i 

process, including Reject Modes, according to the present invention. 

j 

Fig. 3 7 is an illustrative example of allayer one event schedule, including time, 

: i 

inputs, outputs, status, time to kill, time offsets, and propagation delays according to 
the present invention, 1 

Fig. 3 8 shows the range of all possiblle timing errors for all switches in a network 

using the illustrative example of switch clock accuracy of ± 1 microsecond, according 

■ I 

to the present invention. i j 

Fig. 3 9 is a timing diagram showing the two-way time transfer clock 

! 

synchronization method according to the present invention. 

Fig.40 shows the two-way time transfer clock synchronization method process 

i 

according to the present invention. j 

I 

Fig. 41 shows an illustrative alternative process of synchronizing layer one 

i 

network clocks according to the present invention. 

i 
j 

Fig.42 shows an exemplary layer one call setup request message parameter list 
according to the present invention. \ 

Fig. 43 shows an exemplary layer one network message flow diagram for the call 
setup process according to the present invention. 

Fig. 44 shows an exemplary layer one! network message flow diagram for the call 

I 

. i 

teardown process according to the present invention. 
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i 
i 

Fig. 45 shows an exemplary layer one network message flow diagram for the 
layer one switching process according to the present invention. 

Fig.46 shows an exemplary layer one network message flow diagram for the 

i 

layer one inter-node call setup process according to the present invention. 

I 

5 Fig.47 illustrates the added efficiency of "headerless" packet switching 

i 

according to the present invention. I 

Fig.48 is a timing diagram shoeing scheduled layer one packet timing, safety 

i : 

zones, and synchronization of I/O buffers according to the present invention. 

Fig.49 is a timing diagram showing scheduled layer one packet timing, safety 
10 zones, and synchronization of I/O buffers, along with standard store-and-forward 
packets illustrating the interaction effects of collisions according to the present 
invention. ! ! 

I - 

Fig. 50 is a timing diagram showing comparisons between different types of 

J ; 

packet, cell, or frame switches versus layer 1 packet switching in a single node 

1 5 according to the present invention. \ 

i ; 

Fig. 51 is a timing diagram shoeing comparisons between different types of 

1 

packet, cell, or frame switches versus layer 1 packet switching in a three node network 

according 10 the present invention. > ' 

i 
t 

20 Detailed Description I 

Fig. 1 shows an illustrative packet, cell, or frame-based network as disclosed in 
U.S. PTO Disclosure Document No. 43 1 129, which has been previously incorporated 
herein by reference. ! 
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Fig. 1 comprises a real-time data source or call originator 1 such as a streaming 
audio/video application source or an Internet phone caller; a departure router, switch, 
or originating edge node 2; a mid-destination router, switch, or middle node 3; a final 

destination router, switch, or terminating edge node 4; and a real-time receiver or 

i 

5 destination 5 for the real-time streaming audio/video application destination and/or 
Internet phone or video conference receiver. 

Fig. 1 also illustratively shows a transmission/communications path 1 1 between 
the real-time data source or call originator liand the departure router, switch, or 
originating edge node 2; a transmission/communications path 12 between the departure 

10 router, switch, or originating edge node 2 and the mid-destination router, switch, or 

i 

middle node 3; a transmission/communications path 13 between the mid-destination 

router, switch, or middle node 3 and the final destination router, switch, or terminating 

I 

edge node 4; and a transmission/communications path 14 between the final destination 

I 

router, switch, or terminating edge node 4 ahd the real-time receiver or destination 

! 
i 

15 node 5. 

Fig. 1 includes upgraded hardware and software 32, 33, and 34 which is added 

j 

to standard packet, cell, or frame network routers and switches designated network 
elements 2, 3, and 4 in order to create the capabilities of the present invention. 

Fig. 1 includes a master clock 6 which communicates with 

■ ■ ! 

20 receiver/synchronization means 22, 23, and 24, thereby enabling the network device 

embodiments of the present invention to synchronize their clocks to a high degree of 

• i 

accuracy. I 

For practical purposes, the preferred embodiment of the present invention uses 
the existing satellite Global Positioning System (GPS) as the master clock 6. The GPS 



4SDOCID: <WO 0011838A1 J_> 



WO 00/11838 



31 PCT/US99/18500 



system and means for synchronizing the network elements will be described in more 
detail later. However, any means for synchronizing the clocks to a high degree of 
accuracy is acceptable, such as synchronization pulses on transmission lines, 

synchronization through radio signals, |atomic, cesium, or radium clocks, etc. 

i 

5 Fig. 2 shows a redrawing of Fig.;l idone in a linear manner with additional 

! ■ 

descriptors to better enable discussion of the flow of data and information from left to 

i : 

right. In this way information can be seen to travel from the real-time source or 

i . 

originator 1 on the left through the network elements comprising departure router or 

I ' 
i 

originating edge node 2, 22, and 32, through mid-destination router or middle node 3, 
10 23, and 33, through final destination router or terminating edge node 4, 24, and 34, 

i ' . 

and finally to real-time receiver or destination 5. In these diagrams, the mid- 

i 

destination router or middle node 3, 23, and 33 are meant to represent a plurality of 

middle nodes 3, 23, and 33. The vertical lines indicate the boundaries or edges of the 

,1 

network with the source 1 and destination 5 lying outside of the network. 

I 

15 Additional hardware/software 32, 33, and 34 includes means to enable a layer 

one or physical layer bypass connection for the transfer of incoming data from one 

i 

incoming line such as transmission path 12 to an outgoing line such as transmission 

! 

path 13 through miri-desiinaiion node 3 and 33. This capability enables real-time oi 
high-priority packets to bypass the standard queuing or buffering means of routers and 
20 switches 2, 3, and 4 and tunnel straight through the node at the physical or layer one 
level. 

Although we have simplified the flow of data in Fig, 1 and Fig.2 to show a flow 
of data from left to right, it is important : to understand that the communications across 
the network are bi-directional, such that a parallel process is occurring in the opposite 
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I 

direction, from right to left as shown in Fig. 3. In Fig.3, the shaded areas indicate the 

j 

flow of information in the opposite direction, such that destination 5 also serves as a 
source of information for this reverse flow, while final destination or termination node 
4 and 34 serve as a departure or origination node. In the reverse flow, mid-destination 
node 3 and 33 continue to represent a plurality of mid-destination nodes, while 
departure or origination node 2 and 32 also serve the function of final destination or 

terminating edge node. A specific example of this two-way flow is when source 1 and 

t 

. ! 

destination 5 are participants in a two-way! phone call such as Internet phone or video 



conferencing. Source 1 serves the role of a source and destination, as does destination 

i 

5. : I 

i 

For purposes of clarity in the present description, we will show all the path 
flows as unidirectional, but for practical purposes, the present invention is bi- 
directional, with the same devices and processes used in both directions. 

■ i 

■ i 

Fig.4 is an illustrative example of the jayer one network showing a first 
preferred embodiment of the network element devices as deployed in the network, 
wherein the device embodiments integrate thle packet, cell, or frame routers or 
switches 2, 3, and 4 within the layer one bypass switching systems 32, 33, and 34 
respectively. In this preferred integrated embodiment, also termed the "integrated" 
embodiment, the layer one controller is theiprimary controller of the entire device, such 

that it can control integrated packet, cell, or frame switches 2, 3, and 4 through control 

■ i 

lines 108, to cause delaying, stopping or starting standard non-real-time, non-high- 

i 

priority store-and-forward packets in the input and output buffers and in the packet, 
cell, or frame switches 2, 3, or 4 respectively for the purposes of scheduling and 
switching layer one real-time or high-priority packets. This integrated embodiment 
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means that standard packets routed through packet, cell, or frame switches 2, 3, or 4 
are not lost due to layer one timing considerations, although they may be delayed. 
Fig. 5 is an illustrative example of the layer one network showing a second 

. • i 

i 

embodiment of the network element devices descriptively entitled an "overlay" 
5 embodiment, wherein the packet, cell, or frame routers or switches 2, 3, and 4 are 

separate devices both structurally and control-wise from the layer one bypass switching 

I 

systems 32, 33, and 34 respectively. The purpose of this "overlay" embodiment is to 
be able to less expensively add layer one switching to existing packet networks with 
existing packet, cell, or frame switches. In this case, only the layer one systems 32, 33, 

10 or 34 along with their synchronization means require additional expense. 

i 

In this second embodiment, the layer one controllers in systems 32, 33, and 34 
are not the primary controllers of the packet, cell, or frame routers or switches 2, 3, 
and 4. Packet, cell, or frame routers or switches 2, 3, and 4 can operate as stand-alone 
units and control their own functionality. The layer one systems 32, 33, and 34 are 

15 "overlaid" on top of or around the standard packet, cell, or frame switches 2, 3, and 4, 
such that standard packets arriving on lines 12 coming into the node 33 go through the 
layer one system 33 and then are routed through lines 56 to the "overlaid" packet, cell, 
or irame switch 2. Output iines coming out ol packet, celi, or frame switch 2 are 
routed through lines 66 back into the layer one system 33 and then out on transmission 

20 lines 14. j ' 

This means that the layer one systems 32, 33, and 34 will be unable to directly 

| ! 

control delaying, stopping or starting standard non-real-time, non-high-priority store- 

! * 

and-forward packets while they are partially or completely in packet, cell, or frame 
switches 2, 3, and 4. As a result, if there is contention for an output port between the 
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i 

layer one systems 32, 33, or 34 and their respective standard packet, cell, or frame 
switches 2, 3, or 4, the layer one control system will prevail and the layer one packet 
that is scheduled will get routed. The standard packet from packet, cell, or frame 
switch 2, 3, or 4 contending for the output port will be stored in the output buffers of 
the respective layer one system 32, 33, or 34. The "overlay" embodiment can be 
designed to store standard packets coming j from the packet, cell, or frame switch 2, 3, 

or 4, to the output buffers, but the output buffers must be large enough to prevent 

i 

! 

overflow if the Level 1 scheduled time is lengthy. 

i 

A third embodiment of the device (not shown because it is a deconstruction of 
the second embodiment) can be implemented in which the "overlay" embodiment is 
used, but the input buffers are removed. This cost-cutting approach, also termed the 

"dummied down" embodiment theoretically could lose incoming packets, cells, or 

i 

frames due to layer one switching contention. However, practically speaking the 
output of the previous switch which is feeding the current input buffers must typically 
uses synchronization flags, frame delimiters, or the like, which is all that would 

probably be lost in this scenario. In the case that standard packets were lost, as they 

i 

inevitably are in congested store-and-forward networks, standard protocols will 

generally ensure retransmission. j 

i 

A fourth embodiment of the device (not shown because it is a deconstruction of 

the second and third embodiments) can be implemented in which the "overlay" 

i 

embodiment is used, but the input and output buffers are removed. This cost-cutting 



approach, also termed the "really dummied 



down" embodiment will undoubtedly lose 



outgoing packets, cells, or frames due to layer one switching contention. In the case 

I 

that standard packets, cells, or frames are;lost, as they inevitably are in congested 
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store-and-forward networks, standard jprotocols will generally ensure retransmission. 
However, this is viewed as a low-cost,; low-performance trade-off and is not preferred. 
Nevertheless, the use of this approach jhas the advantages that layer one packet 
switching with its benefits can be implemented over an existing store-and-forward 
5 network at very low cost, thus giving layer one performance at the expense of 

degraded standard packet, cell, or frame-based performance. 

I 

Fig. 6 is an illustrative example of the layer one network showing a fifth 

embodiment of the device, descriptively; entitled the "source and destination" or "end- 

i 

user" embodiment, wherein the layer cine system functionality has been moved outside 

I . 

1 0 of the network boundaries into the source and destination devices themselves. In this 

! ; 

fifth embodiment of the device, synchronization means 21 is using the same master 

I ■ 

i 

clock 6 to synchronize the layer one system 3 1 in the source device 1 . In the same 

i 1 

manner, synchronization means 25 is using the same master clock 6 to synchronize the 

! 

I . 

layer one system 35 in the destination device 5. Since all of the layer one devices 31, 

15 32, 33, 34, and 35 are synchronized tojthe same master clock 6, the entire chain can 

j ; 

easily implement layer one switching functionality end-to-end. The purpose of this 
"end-user" embodiment includes being! able to decrease delay time, response time, and 

jit Lei even funnel by uol requiring leai-ume oi hign-pi 101 uy packets u> nave 10 be 

i ■ , 
buffered by the originating node 32 while waiting for the scheduling time. In this way, 

20 the layer one enabled end-user devices; 1 and 5 will know what the layer one schedule 

is and can deliver their real-time or high-priority application data in a "more 

knowledgeable and hence efficient manner. Although Fig. 6 shows these end-user 

device embodiments outside of the network boundaries, they also could be considered 



I ! 
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network elements, as they can now function as part of the layer one network since they 
move some network functionality to the end-user device. 

Fig. 7 is a simplified illustrative example showing elements of a seventh 

j 

embodiment or "pure layer one" embodiment of the present invention, wherein the 

! 

standard packet, cell, or frame routers or switches 2, 3, and 4 have been removed 

i 

entirely, such that the network element "pure layer one'* embodiment device consists 
exclusively of the layer one hardware and software 32, 33, and 34, together with 
synchronization means 22, 23, and 24. This means that this network performs 
scheduled layer one switching exclusively, such that standard store-and-forward packet 
switching does not take place in this embodiment of the present invention. As a result, 

in Fig. 7, source 1 would request a scheduled time across the layer one network. If the 

j 

network elements accepted the request, source 1 could transmit its information across 

the network according to the scheduled times. Source 1 would compete for network 

i 

| 

resources from other layer one scheduled sessions, but only layer one resources and 

. j 

switching would be consumed. No store-arid-forward packet switching would take 

. ! 

place across this embodiment of the layer one network. 

I 

Fig. 8 is an illustrative examples of a; more complex version of a layer one 

i | 

network showing the previously described sources, destinations, and layer one network 

elements interconnected. Master clock 6 is still used to synchronize all of the device 

i 

embodiments. 

In Fig. 8, Source la and Destination 5a are illustrative examples of the sixth 
device embodiment also termed the "LAN" embodiment. Source la exemplifies a 
layer one-capable Ethernet-style LAN controller, bridge, or router. Destination 5a 



WO 00/11838 1 3 7 PCT/US99/18500 

exemplifies a layer one-capable Token Ring or other ring-style LAN controller, bridge, 
or router. Layer one star-type LANs jcould also be implemented in the same manner. 

In all of these "LAN" embodiments a Local Area Network or LAN is connected 

i 

' ' I 

to the layer one Network, such that the LAN controller, bridge, router and/or switch 
5 la includes layer one functionality 31 and timing synchronization means 21, and is 

connected to a layer one switch 32 inithe network. In this way layer one LANs can be 
connected to layer one networks. "LAN" device embodiments may consist of the 
LAN controller la having layer one functionality 31 and timing synchronization 21 
either with or without the LAN-attached devices having layer one functionality. If the 
10 LAN-attached devices do not have layer one functionality, they can still send real-time 
or high-priority messages by sending them via the normal LAN protocols to the layer 
one enabled LAN controller la, 3 1, and 21, which then acts as an edge node, stores 

the packets, sets up the layer path to the destination and then schedules the release of 

.i 

the packets. ! ! 

| 

15 Alternatively, Fig. 8 shows thatjthe "LAN" device embodiment can comprise the 

t 

! 

! 

LAN controller la, 21, 31, with LAN[attached devices le, 21a, 31a; If, 21b, 31b; and 
Ig, 21c, 31c representing a layer one synchronized LAN, with said devices attached to 

I 

ihe LAN having iayej one functionality as wcli as me LAN conirollei la. 

i 

In this configuration, the LAN controller, bridge, router, and/or switching 
20 device la with layer one functionality means 3 1 could synchronize with the network's 
master clock 6, such as a GPS system using synchronization means 21. The devices on 
the LAN le, If, and lg with layer one capability 3 la, 3 lb, and 31c respectively, could 
then synchronize off of the LAN controller la using timing synchronization means 21a, 
21b, and 21c, respectively. This method of synchronization could be similar to the 
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NTP method cited in the TrueTime reference. Alternatively, the devices on the LAN 
le, If, and lg could use timing synchronization means 21a, 21b, and 21c respectively 
with other timing synchronization methods j such as the two-way time transfer method 
cited in the U.S. Naval observatory reference, or they could each synchronize directly 

! 

with the GPS system. ■ 

Fig. 8 also shows destination 5a as an illustrative example of a ring-style "LAN" 

embodiment of the device, wherein a Localj Area Network or LAN is connected to the 

i 

! 

layer one Network. In this example the LAN controller, router, and/or destination 

i 

I 

switch 5a includes layer one functionality 35 with timing synchronization means 25 and 

is connected to layer one switch 34 in the network. In this way layer one switching 

i 

can be connected to LANs as well as other devices. "LAN" device embodiments may 
consist of the LAN controller 5a having layer one functionality 35 and timing 
synchronization 25 either with or without the LAN-attached devices having layer one 
functionality. If the LAN-attached devices do not have layer one functionality, they 
can still send real-time or high-priority messages by sending them via the normal LAN 
protocols to the layer one enabled LAN controller 5a, 35, and 25, which then acts as 
an edge node, stores the packets, sets up the layer path to the destination and then 
schedules the release of the packets. i 

Alternatively, Fig.8 shows that the "iiAN" device embodiment can comprise the 
LAN controller 5a, 25, 35, with LAN-attached devices 5e, 25a, 35a; 5f, 25b, 35b; and 

5g, 25c, 35c in a token ring style configuration, representing a layer one synchronized 

1 

LAN, with said devices attached to the LAN having layer one functionality as well as 
the LAN controller 5a. 1 i 
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In this configuration, the LAN controller, bridge, router, and/or switching 
device 5a with layer one functionality means 35 could synchronize with the network's 

master clock 6, such as a GPS system using synchronization means 25. The devices on 

i . 

the LAN 5e, 5f, and 5g with layer onej capability 35a, 35b, and 35c respectively, could 
then synchronize off of the LAN controller 5a using timing synchronization means 25a, 
25b, and 25c, respectively. This method of synchronization could be similar to the 
NTP method cited in the TrueTime reference. Alternatively, the devices on the LAN 

5e, 5f, and 5g could use timing synchronization means 25a, 25b, and 25c respectively 

i 

with other timing synchronization methods such as the two-way time transfer method 
cited in the U.S. Naval observatory reference, or they could each synchronize directly 
with the GPS system. 

In layer one "LAN" embodiments, the LAN software in all of the LAN devices 

would be upgraded to include the capability to suspend normal LAN contention or 

i 

action during scheduled layer one events. Each LAN device would listen for scheduled 

layer one events and not transmit during those times. When scheduled layer one events 

! ■ 

were not occurring, LAN contention would resume as normal. Since all of the LAN 

i 

devices would be synchronized, they cjould easily perform these capabilities and could 

! 

communicate at a layer one ievel to other devices on the same layer one enabled LAN, 
to devices on adjoining layer one enabled LANs, and/or to devices in other 
interconnected layer 1 networks. This^ means that applications such as the integration 
of voice mail and email could be consolidated or integrated onto a single platform and 
in a single networking environment, even though email arrives at the application by 
standard store-and-forward networking, while voice mail arrives using layer one * 
networking. j 
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In Fig. 8, Source lb exemplifies a source connected directly to the layer one 
network through transmission line 1 1 . Source lc exemplifies a host system with layer 
one switching capability. 

Source Id in Fig. 8 exemplifies a layer one network that is connected to a 
5 separate layer one network. In this case, the layer one networks can establish seamless 
layer one sessions and route seamless layer one switching end-to-end across both layer 
one networks. Even when these interconnected layer one networks are not 
synchronized off of the same master clock '6, there are methods which will be explained 
subsequently, whereby the layer one nodes in different networks can determine very 
10 accurately the differences in times between their clocks and the clocks of adjacent layer 

one nodes, and the propagation delay between the nodes. With this information, they 

! 

can calculate and use offsets to adjust for their timing differences and propagation 

delays such that the layer one scheduling between adjacent nodes is highly accurate, 

i 

highly efficient, and error-free. ' ! 

: ! 

1 5 Destination 5b exemplifies a layer one enabled end-user destination receiving 

layer one routing directly to its internal layer one system 35 through transmission line 
14. Destination 5c exemplifies a host system with layer one switching capability. 

Destination 5d in Fig. 8 exemplifies a layer one network that is connected to a 

i 

different layer one network as already discussed. A plurality of layer one networks can 

| 

20 be interconnected for extremely rapid transfer of data through all of the networks. 

Fig. 9 shows a high level block diagram of a first embodiment, also termed the 

"integrated" embodiment, of an integrated layer one switch. This preferred 

i 

embodiment integrates a packet, cell, or frame switch 100 into the rest of the layer one 
switch 32, 33, or 34, comprising a first input switch array 59; an input buffer array 60; 
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j ■ 

a second input switch array 61; a contrqller 120 with timing synchronization means 22, 
23, 24; a non-blocking, non-delaying switch 150; a first output switch array 62, an 

* output buffer array 63, and a second output switch array 69. 

i 

In this preferred embodiment, both layer one packets and standard packets, 

j- 

5 cells, or frames are routed from the previous node to the input lines such as Ini 40. In 

l 

standard packet mode, while standard packets, cells, or frames are streaming into input 

! 

line 40 the layer one switch controller 120 uses control line(s) 42 to position switch 41 
into the position to route the standard packets, cells, or frames from input line Ini 40 
to input buffer InBufferi 45. Here thej standard packets, cells, or frames are stored 

10 while the controller 120 determines where each packet should go and which packets to 

i 

I 

route first. To do this, the InBufferi 4$, looks at each packet, cell, or frame and 
determines its layer three destination o|r layer two flow path or equivalent, and its 
priority, if any. Using the layer three destination or layer two flow path or equivalent, 

the controller 120 then looks at its routing or flow table and determines the next 

i 

1 5 destination and which output line the packets, cells, or frames are to be sent out on. It 

j . 

may at this point insert the next destination into the packet, cell, or frame, or perform 

this operation in the output buffer OutBufferj 70. Alternatively, for high speed packet, 

l 

cell, or frame switching, the routing table can be stored in a high speed cache as pan oi 

the InBuffer circuitry. , 

j 

20 Once the destination is determined, if standard packet, cell, or frame priority 

systems such as Quality of Service (QOS), Class of Service (COS), Resource 
Reservation Protocol (RS VP) or other priority schemes are incorporated in the device, 

the controller 120 or InBufferi 45 uses the priority level to determine which packets, 

i 

cells, or frames should be moved out of the buffer first into the packet, cell, or frame 

i 

i 
i 

j • 
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switch fabric 100. Otherwise a simpler algorithm such as round-robin may be used or 
any other sharing algorithms well-known to those skilled in the art. 

Before moving a standard packet from the InBufFer] 45 to the packet, cell, or 

frame switch 100, the controller 120 first looks at the layer one schedule to be sure 

! 

that moving the standard packet out of the InBufferi 45 will not conflict with a 
scheduled layer one packet due to arrive on input line ln { 40. Based upon which 

i 

output line Out n the packet is supposed to route out of, the controller 120 also looks at 

the layer one schedule to be sure that moving this packet out of the InBufferj 45 will 

I 

not cause it to load into the output buffer OutBuffer n at a time when it will conflict 
with a scheduled layer one packet due to be switched through on that output line Out n . 
When the controller determines that no layer one conflict will occur at that input port, 

it uses control line(s) 58 to positions switch 55 such that the non-layer one packet, cell, 

i 

or frame will be routed to the packet, cell; pr frame switch 100. It then triggers the 

InBuffen 45 to move the packet, cell, or frame into packet, cell, or frame switch 100 

i 
i 

via switch 55 and line 56. | 

Packet, cell, or frame switch 100 uses standard packet-oriented switch fabric 
well-know to those skilled in the art to route the packet to the correct output line, 

which for illustrative purposes we choose to be line 66. Since controller 120 has 

i 

already determined that there is no layer one conflict with output buffer OutBuffen 70, 

. i 

controller 120 uses control Hne(s) 68 to position switch 65 so that the packet will route 

. . i 

into OutBufferi 70. The packet, cell, or frame then routes out of switch 100 through 
line 66, through switch 69, and into OutBufferi 70. 

Either controller 120 and/or OutBufferi 70, now determine which packets 

i 

should be shipped out first based on priorit|. When OutBufferi 70 is ready to ship a 



WO 00/11838 i 43 PCT/US99/18500 

packet, cell, or frame out of output line Outi 81, controller 120 checks the layer one 
schedule to be sure that no layer one packets, cells, or frames are scheduled to be 

i 

shipped out of output line Outi 81 during the time it takes to send out the next standard 
packet. OutBufferj 70 can compute the time that it will take to send the next outgoing 

standard packet, cell, or frame because it knows how fast its output link is and how 

I 

large the next packet, cell, or frame is by looking at its header or by examining the 
space taken up in the buffer. If there will be a conflict between a scheduled layer one 
packet on this output line Outi 81 and a standard packet from OutBufferi 70, the 
scheduled layer one packet takes priority and OutBufferi 70 holds the outgoing packet 

until the layer one scheduled event is completed. This process is then repeated 

j 

continuously, thus shipping layer one packets, cells, or frames at scheduled times, arid 
standard packets, cells, or frames at no,n 7 layer one times. 

When a layer one packet is scheduled to arrive on input line Ini 40, the master 
controller 120, uses control line(s) 42 and 58 to shift input switches 41 and 55 
respectively to the bypass position, such that packets will not flow from input line Ini 
40 to the InBufferi 45. Instead the layer one packet, cell, or frame is routed directly 
from input line Ini 40, through bypass line 44, through switch 55 to line 57, and 
directly mio the non-biocking, non-delaying swiich 150. Ai precisely the same lime, 
controller 120 uses control lines 125 to cause non-blocking, non-delaying switch 150 
to route the layer one packet, cell, or frame directly from the line 57, through switch 

1 50 and out the correct line 67. At precisely the same time, using control line(s) 68 

j 

and 80, controller 120 also positions switches 65 and 79 respectively such that the 
scheduled layer one packet, cell, or frame routes through from non-blocking, non- 
delaying switch 150 on line 67 through 1 switch 65 to the buffer bypass line 77, out 
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switch 79 to output line Outj 81 and on to the next layer one switch which repeats the 
process. ; 

There is one variation to the way that; layer one switching works that occurs 
only when the layer one Switch is the first layer one device in the layer one path, i.e., 
either it is the originating edge node 32, see;Fig.4, or it plays the role of an originating 
edge node as does layer one switching means 3 1 in Fig. 6. This is because, when a 
layer one switch is the first switch in the path from source to destination, there is no 
preceding layer one entity to send the layer one packets at the precise times required. 
Consequently, the originating edge node 32 must hold the layer one packets, cells, or 
frames that it receives from the non-layer one source or originating device 1 in its input 
buffer InBuffen 45, see Fig.9, until the scheduled layer one event occurs. The 
controller 120 for the originating edge node 32 must then, at the scheduled time, 

i 

switch to layer one mode and cause the input buffer InBufFen 45 to release the layer 

one packets through the non-blocking, non-delaying switch and on through the rest of 

i 

the layer one path. AJ1 of the subsequent layer one devices work as previously 

described. j 

i 
i 

Fig.9 also illustrates how store-and-forward messages are communicated over 
the standard packet network both from and to the controller 120 from sources 1, 
destinations 5, and other network elements 2 1 , 3, 4, 32, 33, and 34. In addition to 



routing end-to-end packets through switch 



100, the controller 120 has a network 



address for standard packet, cell, or frame rhessages whereby switch 100 routes these 

I 

messages to controller 120 through line 1 06. | Controller 120 can also send standard 

| 

packet, cell, or frame messages through line 107 to switch 100 for routing to the 
network. 
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Fig. 9 also illustrates how layer one messages such as emergency messages, 
synchronization timing messages, and administration messages are communicated from 

i 

and to the controller 120 from other layer one devices. In addition to routing layer 

I 

one packets through switch 150, the controller 120 has a network address for layer 

5 one messages whereby switch 150 routes these messages to controller 120 through line 

i 

123. Controller 120 can also send high-priority scheduled layer one messages such as 

t ■ 

! 

emergency messages, synchronization timing messages, and administrative messages 
through line 124 to switch 150 for routing to the network. 

Fig. 10 illustrates a second embodiment of the device, also termed the "overlay" 

i j 

10 embodiment, wherein the packet, cell, or frame switch 100 is a separate, non- 

! ■ . - 

integrated device, as explained previously. Fig, 10 works in the same manner as the 

. . i ' 

preferred embodiment shown in Fig. 9, except that there is no control means 108 



between controller 120 and switch 100 



From a practical standpoint, controller 120 



can still control when it sends packets from InBufferi 45 to switch 100, so that it can 
15 avoid layer one conflicts when transferring standard packets, cells, or frames in 

InBuffen 45 to switch 100. However, bontroller 120 cannot control when separate 

i 

and discrete switch 100 will send packets, cells, or frames into OutBufFeri 70. The 

i 

solution is to modify the first output switch an ay o2 in the non-imegi at'ed secona 

' j . 

embodiment as shown in Fig. 10. This modification comprises removing the first 
20 output switch array 62 including switch 65, line 69, and control line(s) 68; then adding 
line 69a such that the output line 66 from switch 100 routes directly from the output of 
switch 1 00 through line 69a into OutBufFeri 70; then adding line 69b, such that switch 

150 feeds out through line 67, directly over line 69b, and into output buffer bypass line 

i 

77. In this way, whenever there is conflict at the output buffer between scheduled 

i 
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layer one packets from non-blocking, non-delaying switch 150 and store-and-forward 
packets from switch 1 00, both packets route without interfering with each other. The 
layer one packets route straight through the bypass line and out of the output line Outj 
81, The store-and-forward packets dump into the OutBuffen 70. The only danger is 
5 that if the layer one schedule is highly filled, OutBuffen 70 may overflow, losing 

packets and causing congestion. This effect |inay be partially ameliorated by increasing 
the size of OutBuffen 70 and decreasing the layer one scheduling commitments thiat 
this embodiment's device is allowed to accept. 

The third and fourth embodiments, descriptively titled the "dummied down" and 
10 "dummied way down" embodiments respectively, are modifications of the second 

embodiment shown in Fig. 10. t 

i 

In the third embodiment, the input buffer array 60 with its input buffers 

InBuffen 45 is eliminated along with the first input switch array 59 with its switches 

j 

41. This means that input line Ini 40 goes directly to the input of switch 55. 

i 

15 Controller 120 continues to use control linesj 58 to control the switching of switch 55 
for layer one switching. However, control lines 42 and 54 are not used in this 
embodiment. 

In the fourth embodiment, the output buffer array 63 with its output buffers 
OutBuffen 70 is eliminated. This means that; lines 66 and 67 go directly to switch 79, 
20 which is still controlled by control line 80. Switch 79 continues to feed output line 

Outi 81. Control line 71 is no longer used in this embodiment. 

i 

Fig. 1 1 is an illustrative example of a fifth embodiment of the device according to 
the present invention, descriptively entitled tlje "end-user" embodiment, wherein the 
layer one system functionality has been moved outside of the network boundaries into 
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i 

the source and destination devices. As discussed previously in Fig. 3, each of devices 

has a source and a destination component. Both the source and destination 

i 

components are shown in Fig. 1 1 . Note that for purposes of drawing similarity and 

i 

i 

clarity, the destination component is on; the left and the source component is on the 

5 right in Fig. 11. The "end-user" embodiment of the device according to the present 

| : 

invention is very much like the first embodiment, i.e., the integrated device 
embodiment, except that the packet, cell, or frame based switch 100 has been replaced 
in the end-user device by industry standard packet-based device input capability 5 and 
industry standard source packet-based output capability 1. This capability includes 

10 various software and hardware means! which are used to apply and strip off the layers 
of protocol required to communicate in a store-and-forward network, such that the 
end user is presented with the application layer information as is well known to those 
skilled in the art. All of these capabilities for standard input and output exist today in 
hardware and software communications applications, e.g., Outlook™ e-mail software 

15 from Microsoft®, Explorer™ web browser from Microsoft®. 

The other change in the "end-user" embodiment from the first embodiment of 

] 

the present invention is the replacement of the non-blocking, non-delaying switch 150 
with real-time packei-onemed input capability 35 and real-time packet-oriented output 
capability 3 1 . An example of this would be software and hardware necessary to 

20 communicate in a real-time application such as Internet Phone. With Internet Phone, 

i 

the real-time packet-oriented input capability 35 comprises various hardware and 

software means to get the voice inputi sample it, digitize it, compress it, and put it in 

i 

regular, periodic packets suitable for layer one transmission. Real-time source output 
capability 3 1 in the example of Internet Phone comprises various hardware and 
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software means to receive layer one packets, assemble them, deliver them to the 
application in a usable way, convert them from digital to analog and play the audio out 
on a speaker. All of these capabilities for real-time input and output exist today in 
hardware and software applications like video conferencing hardware and software 

5 from Intel®, Internet Phone™ from VocalTec®, and Netshow™ from Microsoft®, 

i 
i 

and streaming audio/video from RealAudio®. 

All of the other capabilities of the "end-user" embodiment are the same as the 
previous embodiments. The controller controls when packets would be shipped and 
received. For a single user, the capabilities might include only one input buffer 45 and 
1 0 only one output buffer 70, but for shared end-user devices there may be multiple lines 
and buffers as shown in Fig. 11. ' 1 

Fig. 12 is an illustrative example of a seventh embodiment of the device 

t 

according to the present invention, descriptively entitled the "Fundamental layer one" 
or "Pure layer one" embodiment, wherein normal packet, cell, or frame store-and- 
1 5 forward functionality of switch 100 has been taken out, leaving only the layer one 
system functionality. This device exclusively switches using the layer one event 

scheduling process described elsewhere in this document. 

i 

Fig. 13 shows a detailed view of exemplary logic circuitry for the input switches 
41 and 55 in the input switch arrays 59 and 61 of the device according to the present 

20 invention. Fig. 13 shows just one of a plurality of means of implementing this switching 

I 

capability. As explained previously, standard store and forward packets coming in on 
input 40 are switched to the input bufYer 45 to await being switched through switch 55 
to store-and-forward switch 100. layer one jackets coming in on input 40 are 
switched through switch 41 to bypass line 44 and on through switch 55 to output line 

i 



^SDOCI D: < WO 00 1 1 838A 1 _l_> j 



WO 00/11838 '! ; 49 PCT/US99/18500 

i ' 

57 and into non-blocking, non-delaying switch 150. Fig. 13 clearly shows that when 

i 

the controller 120 makes the control line 42 high for switch 41, the top AND gate 
turns on and switches whatever is on input line 40 through to line 43 and the input 
buffer. At the same time, this turns the lower AND gate off and prevents any input on 
5 line 40 from being switched through to line 44. Conversely, when the controller 120 
makes the control line 42 low for switch 41, the top AND gate turns off and prevents 
whatever is on input line 40 from being passed through to line 43 and the input buffer. 

i i 

At the same time, this turns the lower AND gate on and switches any input on line 40 

.1 

through to line 44. The rest of the logic is the same, and is very clear to those skilled 

| 

10 in the art. Thus, it will not be explained further. 

i 

Fig. 14 details the input means or input circuitry operational process, specifically 
for when the input means are operating as "edge buffers" providing the initial buffering 
for the originating layer one device or originating edge node in a network. 

Fig. 15 details the input means or input circuitry operational process, specifically 
15 for when the input means are operating as "non-edge buffers", i.e., internal to the 
network as middle nodes or terminating nodes. 

Fig. 16 shows a detailed view of exemplary hardware and software circuitry and 
lunctionaliiy loi the input bufier InBuliei x 4:; of the device according to the present 
invention. As packets are routed to line 43, they are shifted into the input handler 46, 
20 which comprises several shift registers, under the control of the input queue manager 
49. Input queue manager 49 is a microprocessor running of a program stored in 

program memory 50 residing on a BAM storage device. Input queue manager 49 

i 

loads the shift registers 46 with packets and transfers them to buffer memory 82, a 

RAM storage device. I 

i 

* « ! ■ 

i 
1 
t 

I 
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Input Queue Manager 49 then looks <at the packets in buffer memory 82, pulls 
out the layer three or layer two address and; detects if there is any priority scheduling 
required. It then looks at the address resolution manager 48 which resides on a RAM 
storage device, and which fundamentally stores routing tables for network address 
5 resolution. These routing tables are updated as needed by the main microprocessor on 

the controller 120. The input queue manager 49 uses the address resolution manager 

t 

48 to look up the address of the next destination for the packet, cell, or frame, and the 

: i 

output port for the switch 100 to switch the| packet out to. When the input queue 
manager has a packet to ship to switch 100,: it notifies controller 120 over bus 54 with 
10 the appropriate information such as the input and output lines, and the size of the 
packet. Controller 120 examines its layer one event schedule to determine if any 
collisions with scheduled layer one packets might occur on those input and output 
lines. If there is no problem, controller 120 triggers switch 55 using control line(s) 58 

and notifies input queue manager 49 to send the packet to switch 1 00, which it does. 

i 

1 5 If the input buffer 45 acts as an originating edge node for the layer one network, 

then controller 120 will use switch 41 to rou|te layer one packets into the input buffer 
45. Controller 120 will tell input queue manager 49 to notify him when the layer one 

packets arrive, based on source and destination addresses and priority level. When the 

i 

layer one packets arrive, they are transieiredj to a special location in buffer memory. 

i 

20 Input queue manager 49 notifies controller 120 when these packets arrive. Controller 

1 20 constantly checks the layer two event schedule and when an event is approaching 

i I 

he notifies input queue manager 49 to havelthem ready. At the designated scheduled 
layer one time, controller 120 throws all the required switches as described previously 



I 
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i 

for direct layer one switching and notifies input queue manager 49 to ship the layer one 
packet(s). 

i 

i 

If the input buffer 45 is not acting as an originating edge node, then it does not 

see any layer one switches, since the controller 120 bypasses the input buffer 45 at the 

i 

scheduled times by switching the layer one packets around the buffer by means of the 

t 

input switches 4 land 55, and buffer bypass line 44. 

i 
i 

Fig. 17 shows an example of the detailed program process which the input queue 
manager 49 performs in the input buffer shown in Fig. 16. 

Fig. 18 shows a detailed view of exemplary logic circuitry for the output 
switches 65 and 79 in the output switch arrays 62 and 64 of the device according to 
the present invention. Fig. 18 shows just one of a plurality of means of implementing 
this switching capability. As explained previously, standard store and forward packets 
coming out of switch 100 on line 66 are sent by line 69 to the output buffer 70 to await 
being transmitted out on output line 8 ( 1 . layer one packets coming from non-blocking, 

non-delaying switch 150 are passed through line 67 and through switch 65 to output 

i 

buffer bypass line 77 and are switched through switch 79 to output line 81. Fig. 18 
clearly shows that when the controller 120 makes the control line 68 high for switch 

65, uie lop AND gate turns on and switches the iayei one packets on line 67 througn 

I 

to output buffer 70. At the same time, this turns the lower AND gate off and prevents 

any input from the layer one packets on line 67 from being switched through to the 

"i 

buffer bypass line 77. Conversely, when the controller 120 makes the control line 68 

i 

low for switch 65, the top AND gate turns off and prevents layer one packets on line 
67 from being passed through to the output buffer 70. At the same time, this turns the 
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lower AND gate on and switches any layer one packets through to the buffer bypass 

i 
I 

line 77. 

The logic in switch 79 then switches between the output buffer 70 and the layer 
one packets on output buffer bypass line 77. The controller 120 by making the 
5 control line(s) 80 high switches packets through switch 79 to output line 81 and turns 
off any packets being fed from line 77. Conversely, by making the control line(s) 80 
low, the controller 120 switches layer one packets on buffer bypass line 77 through 
switch 79 to output line 81, while blocking any data from output buffer 70. 

Fig. 19 and Fig. 20 detail the output means or output circuitry operational 
1 0 process, specifically for when the output means are operating as "edge buffers" 

providing the final buffering for the terminating layer one device or terminating edge 

i 

node in a network. ! 

I 

i 

Fig.21 and Fig.22 detail the output means or output circuitry operational 
process, specifically for when the output m ! eans are operating as "non-edge buffers", 

i 

15 i.e., internal to the network as middle nodes or originating nodes. 

Fig.23 shows a detailed view of exemplary hardware and software circuitry and 

functionality for the output buffer OutBuffer! 70 of the device according to the present 

invention. As packets are routed out of switch 100 to line 65, they are sent to the 

output queue manager 72. j 
20 Output queue manager 72 is a microprocessor running a program stored in 

program memory 74 residing on a RAM storage device. Output queue manager 72 

i 

receives the packets and transfers them to'b!uffer memory 83, a RAM storage device. 

i 

i 

Output queue manager 72 then looks at the packets in buffer memory 83, to see 
if there is any priority scheduling required. When the output queue manager 72 has a 
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selected a packet to send to output line 81, it transfers the packet from buffer memory 
83 to the output handler 73, which comprises a plurality of shift registers under the 
control of the output queue manager 73. 

Output queue manager 72 then^ notifies controller 120 over bus 71 that the 

i 

! 

5 packet is ready to transmit, and tells it other appropriate information such as the output 
line, the priority, and the size of the packet. Controller 120 examines its layer one 
event schedule to determine if any collisions with scheduled layer one packets might 
occur on those input and output lines. If there is no problem, controller 120 triggers 
switch 79 using control line(s) 80 and 1 notifies output queue manager 72 to send the 

10 packet out line 81. 

Headerless packet switching is a layer one switching technique that extracts the 
layer two and layer three source and destination addresses for layer one scheduled 
packets. If headerless packet switching is being implemented in the network, then 
layer one packets without their layer two and layer three source and destination 

1 5 addresses must be have these addresses reinserted at the terminating edge node prior 
to leaving the layer one network. If this output buffer acts as an terminating edge 

node, then the controller 120 alerts the output queue manager 72 of the upcoming 

! 

iayei one ''headerless 1 ' packet. Since layei one's event scheouier knows the correct 

I 

source and destination addresses based on its scheduling, the controller 120 will also 

I 

20 give the correct source and destination address(es). When the packet arrives, the 

controller actuates switch 65 to route the packet to the output queue manager 72. The 

i 

controller 120 then signals the output queue manager that this is a "headerless" packet. 
The output queue manager 72 stores the headerless packet in buffer memory 83. Next 
the output queue manager inserts the correct source and destination address(es) into 



BNSDOCID: <WO_ 001I838A1J__> 



WO 00/11838 54 PCT/US99/18500 

the packet headers and then, with the permission of controller 120, routes the packet 
out line 81. 

Fig.24 shows an example of the detailed program process which the output 
queue manager 72 performs in the output buffer shown in Fig.23. 
5 Fig.25 shows a detailed view of exemplary hardware and software circuitry and 

functionality for the non-blocking, non-delaying layer one switch of the device 
according to the present invention. There are a plurality of methods to implement this 
non-blocking, non-delaying switching methods according to the present invention. 
This is just one example of a plurality of possible designs that could be used. Fig.26 
10 shows a detailed illustrative example of one input to output path for the non-blocking, 
non-delaying layer one switch of the devicej according to the present invention. 

In Fig.25, scheduled layer one packets are switched from the second input 
switch array into the non-inverting amplifiers 157, 158,159, and 160 which may also 
act as repeaters and clean up the signal. Input line 151 feeding non-inverting amplifier 
15 157 is a means whereby the controller 120 can send scheduled layer one packets. 

Once the layer one packets exit non-inverting amplifiers 157, 158, 159, and 160, 

i 

each input signal is sent down its respective! bus 161, 162, 163, and 164. Output buses 
153, 154, 155, and 1 56, which are tapped on to these input buses 161, 162, 163, and 
164, respectively, are configured such that every possible output receives every 
20 possible input, thus the switch is non-blocking. The switch is also configured such that 

all inputs 161, 162, 163, and 164 are immediately available at all outputs 153, 154 

• j 

] 55, and 1 56, resulting in no time switching! nor space switching delays, thus the 

! 

switch is non-delaying. Although there are yery small propagation delays, even these 
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have been minimized. This is an important aspect of the invention, as the efficiency of 
the invention is dependent upon the timing involved. 

Fig. 25 illustrates how messages are received by the controller 120 from the non- 
delaying non-blocking switch 150, through output line 166 and 123. Other output 
5 lines 67 are routed to the first output buffer switch array 62. 

Fig. 26 shows an illustrative functional example of how output switch 165 is 

configured such that only one of the output buses 153, 154, 155, or 156 is switched to 

! 
i 

the output line 166. j 

i 

i 

Fig. 27 is an illustrative, exemplary non-inverting amplifier circuit well-known 

10 and understood by those skilled in the art. It is one example of a plurality of circuits 

i 
I 

which may perform this function. The! specific design should be such as to obtain the 
minimum time delay from output to input. The non-inverting amplifier 157 may be 
optional at this exact point in the circuit, but devices such as these may be needed for 
signal strength, isolation, and good design characteristics. The important point is to 

! • 

1 5 keep time delays to a minimum. The qntire device and network implementation should 

. j ! 

thus be designed to reduce or minimize time delays from start to finish throughout the 

i 

entire layer one data path. j 

i ■ 

Fig. 28 shows an iliusiraiive example ai ihe iogicai ievei oi one oi a piu rainy oi 
ways that this switching circuit might be implemented. Binary control lines 125a, 
20 125b, and 125c with a binary numbering scheme are used to select the specific 

i 
| 

sequential control line 125 which then ;switches on the correct output line 153, 154, 

i 

155, or 156. A triggering control line may also be used as well as other logic devices 

i 

| 

which are well known in the art. In this example, it is clear that sequential control line 
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that is made high will switch the corresponding output line 153, 154, 155, or 156 to 

! 

the output line 166. 

Fig.29 provides an illustrative example of the packet, cell, or frame switch 100. 

The specific details of the switch 100 shown are one of a plurality of store-and-forward 

i 

switch implementations well known to those skilled in the art. These details are not 
the focus of this invention and will not be covered here. Virtually any store-and- 
forward switch may be used for switch lOOi The inputs and outputs for switch 100 
have already been discussed. Controller 120 uses control lines 108 to route packets 
through the packet switch. Lines 1 06 and 1 07 are input and output lines which enable 
controller 120 to receive and transmit standard packets through the packet switch 100 
for various communication purposes such as call setup. 

Fig. 30, Fig.3 1, Fig.32, Fig.33, and Fig.34 show how the controller 120 works. 
Fig. 30 is a functional block diagram showing the key functional components of the 
controller 120. FigJ 1 is a block diagram of the hardware for controller 120. Fig.32 is 
a Logic Diagram for controller 120 showing a flow chart of the various aspects of the 
logic process. Fig. 33 and Fig.34 show the process that the controller 120 uses to 
operate the switch. Together, these figures provide the workings of the controller 120. 

Fig. 30 shows controller 120 comprising the master controller 134, the master 
packet switch controller 127, the clock synchronization system 128, the master clock 

receiver 22, 23, or 24, the layer one event database 129, the reservation manager 130 

I 

the output queue manager 136, the master LI switch controller 132, the input queue 

manager 133, node manager 126, input lines 106, 120, and 123, output lines 124, 122, 

! i 

: i 

and 107, and control lines 135 for internal cbmmunication, control lines 108 for 
communication with switch 100, control lines 125 for communication with switch 150, 
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control lines 42 for communication with input switch array 59, control lines 54 for 
communication with input buffer array 60, control lines 58 for communication with 
input switch array 61, control lines 68 for communication with output switch array 62, 

control lines 71 for communication with output buffer array 63, and control lines 80 

i 

5 for communication with output switch array 62. 

Fig. 31 shows the hardware layer of controller 120. At this level, controller 120 
comprises master controller microprocessor 134a for running the master controller 
program stored in shared memory controller 134b; shared memory 134c for routing 
tables; input buffer 133 for getting external network input from switch 100 and switch 

10 150; output buffer 136 for transmitting messages externally through switches 100 and 
150; master clock receiver 22, 23, 24;|clock synchronization mechanism 128; local 
clock 138; packet, cell, or frame switch controller 127a for controlling switch 100; 
packet, cell, or frame switch microprocessor 127b for running the control program for 
switch 100 store in memory 127c; and; layer one switch controller 132c for controlling 

15 switch 150; layer one switch microprojcessor 132b for running the control program for 
switch 150 stored in memory 132a, which also includes the layer one reservation 
schedule. 

Fig. 3 2 shows the functional and relational diagram lor controller 120, wherein 
the input queue manager gets input from packet, cell, or frame switch 100 or layer one 
20 switch 150. The input queue manager strips off the flags and sends the packets to the 
routing manager. The routing manager determines what type of message it is and 
sends it to the appropriate function. If the message is a layer one message, such as a 
call setup reservation request, an accept message, or a reject message, the routing 
manager sends the message to the reservation scheduler. If the message contains 
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! 

network routing update information, the routing manager sends the message to the 

i 

network routing process to update the network routing tables. If the message is an 
administrative message, the routing manager sends it to the node manager. 

i 

When the layer one reservation scheduler gets a reservation message, it checks 
the routing table to determine which input and output lines may be affected. Then it 
looks at the layer one event schedule to determine whether the event can be scheduled. 
This entire layer one event scheduling procelss is detailed in Fig.35 and Fig.36, with the 
layer one event schedule illustrated in Fig. 3 7. Based on the layer one event schedule it 
either schedules the event, tentatively schedules the event, makes the event available 
again, or does nothing. It then tells the message generator which message to send as a 
response. The message generator generates a message, checks the network routing 
table for addressing information and sends the message to the output queue manager to 
transmit over switch 100 or switch 150. The layer one reservation scheduler may also 
check the mode selection to determine how the system administrator through the node 
manager wishes for it to respond to a rejection message. This process is described in 

• ! 

! 

Fig.36. 

I 

As events are scheduled in the layer one Event schedule (see Fig. 37) by the layer 
one event scheduler (see process in Fig.35 and Fig.36), the layer one reservation 

executor continuously looks at the event schedule to determine which layer one events 

! 

are approaching execution. It alerts the master controller 134 regarding these events 
in enough time for the master controller to ekecute the appropriate action at the 
correct time, specifically enabling layer one switching. 

The node manager handles input and output from the a user console, to enable 

I 

the system administrator to control the system. 
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Fig.33 and Fig.34 further explainithe master controller 134 process, step by 

step. 

Fig. 3 5 and Fig. 3 6 are flowcharts which detail the entire layer one event 
scheduling process as explained previously. 

5 Fig. 3 7 exemplifies the layer onej event schedule. This is just one illustrative 

i 

representation, as it could be represented and managed in a plurality of ways. It 

i 

includes a column representing the time f in day (dd), hour (hh), minutes (mm), seconds 

i : . 

(ss), thousandths of seconds (mmm), millionths of seconds or microseconds (M-M-M-), 

! i 

and hundreds of nanoseconds (n), although it could be even more precise if the 

t 

i 

10 synchronization accuracy supported it, Next are shown the input line and output line 

i 
i 

that could be potentially scheduled for! a potential path through the node. Next to the 
input and output lines is an indication of whether the line acts as an edge buffer or edge 

node, i.e., is it the originating or terminating line into or out of the layer 1 network. If 

i 
t 

so, it acts slightly differently as described in Fig. 14, Fig. 15, Fig. 19, Fig.20, Fig.21, and 

i ■ 

1 5 Fig.22. Next is shown the status of the path through the node, whether this path is 

i 
! 

scheduled, tentatively scheduled, available, or reserved specifically for standard 

packets, cells, or frames. Times reserved for standard packet, cell, or frame switching 

I 

' are shown beiow the dashed line. TheJ next column is a "Time to KilT column in winch 
a timer is set for a scheduled session. If there is no layer one activity during that layer 
20 one interval on that path for a certain period of time, the "Time to Kill" timer will 

expire and tear down the session. The next two columns, 'Time Offset to Next Node" 

and "Propagation Delay to Next Node", indicate the difference in clock synchronization 

i 

time and propagation delay between this node and the next node connected to that 
incoming line as measured by the two-way time reference method discussed in Fig. 39 
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and Fig.40. This event schedule could add additional elements as well and be 
represented in a plurality of ways. 

Fig. 3 8 and Fig. 39, are timing diagrams used to clarify the timing synchronization 
processes outlined in Fig.40 and Fig.41, andj used by the present invention for time 
5 synchronization purposes. Fig. 3 8 shows an illustrative example to calculate the range 
of all possible errors for all layer one switches in a layer one network. Fig. 3 8 shows a 
timing diagram at the top of the page, beginning with a master clock reference 
accuracy down to the hundreds of nanoseconds. The clock itself is shown 
incrementing from left to right and shows minutes (mm), seconds (ss), thousandths of 
10 seconds (mmm), millionths of seconds or microseconds (\JL\JL[i), and hundreds of 
nanoseconds (n). Practically speaking, relatively inexpensive GPS enables timing 
systems are currently available offering accuracies of ±1 microsecond. Using +1 
microsecond as an illustrative accuracy number, Fig.38 shows that if all layer one 
switches in the layer one network were accurate to within ± 1 jasecond, then the 
1 5 maximum leading error of switch 1 versus the maximum lagging error of switch 2 
would result in a total possible range of errors for all the nodes of only 2 (iseconds. 
Temporarily ignoring propagation delay, this| means that if a layer one packet were to 
be sent across a layer one network according to the present invention, every node in 
the network would be able to predict that packet's arrival time to within + 2 

i 

t 

20 microseconds such that the total possible error range for a node awaiting the packet's 

I 

arrival is + 2 microseconds or 4 microseconds. In other words, all nodes will receive 

all expected layer one signals in this 4 microsecond window. 

■ i 
: I 

Illustratively, if the layer one switch was operating at DS-1 speeds of 1.544 



Megabits per second, 4 microseconds would be the equivalent of 6. 176 bits. Thus, 
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waiting for the layer one packets on that input or output line would result in a 
maximum loss of 7 bits. This is not even the size of an address header. Alternatively, 
if the layer one switch was operating at 1 Gigabits per second, 4 microseconds would 
be the equivalent of 4000 bits or 500 octets, about the size of several address headers. 
5 If the timing synchronization system was made accurate to within ± 100 

nanoseconds, as some GPS systems arej then the range of all possible timing errors 
would be 400 nanoseconds or + 200 nanoseconds. Illustratively, if the layer one 
switch was operating at DS-1 speeds of 1.544 Megabits per second, 400 nanoseconds 
would be the equivalent of 0.6176 bits, or less than 1 bit. Alternatively, if the layer one 

10 switch was operating at 1 Gigabits per second, 400 nanoseconds would be the 

l 

equivalent of 400 bits or 50 octets, about the size of an address header. Consequently; 

i 

this system would work well with headerless packets as shown in Fig.47, in which the 
address headers and other repetitive information is removed, thus leaving a margin for 
timing errors. i 
1 5 Fig. 3 9 and Fig.40 illustrate the two-way time transfer technique for determining 

very precisely the differences in timing between two nodes and the propagation time 

i 

between the nodes. This is very similar to the two-way transfer technique as shown in 
itie U.S. Is'avai Observatory reference.! Using the same numbers as in the previous, 
illustrative example, Fig. 39 shows on a timing diagram a graphical illustration of the 
20 two-way time transfer technique, in which switch 1 has a maximum leading error of + 1 
microseconds from the master clock reference, while switch 2 has a maximum trailing 
error of-1 microseconds from the master clock reference, resulting in a total one-way 
propagation time of 2 + some variable x microseconds. 

~~ i 
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Fig.40 describes and explains how the two-way time transfer process works, 
specifically as it relates to Fig.39 wherein each node timestamps a packet and 
immediately sends it to the other node, who then timestamps it immediately upon 
receipt. When both nodes do this, even if their clocks are not accurately aligned, they 
can send each other their results, such that .with the timestamps on both packets, it is 
easy to compute very precisely both the difference error between the 2 nodes' clocks 
and the propagation time between their nodes. The differences in clock times and the 
knowledge of propagation delay enable each node to calculate time offsets for each 
input and output line, and then to either adjust their clocks and relative timing or 
compensate for the known difference in timing. Illustrative examples of these offsets 
are shown on the Event Schedule in Fig.37.! 

In addition to the previous time synchronization techniques, Fig.41 illustrates an 
additional process that could be used by the layer one network to self-synchronize. In 
this way, the entire layer one network could operate by having a non-Global 
Positioning System master clock. This approach would serve to start up and maintain 
the layer one network in self-synchrony or could be used if the GPS system failed. 

Fig. 42 shows the parameters used to set up a layer one Call Setup Request 
Message. The value of these parameters would generally be sent from the Source 1 to 
the first layer one node. However, they may be negotiated between the source and the 
layer one node, or negotiated between the nodes. This could occur as part of the 
various reject modes (see Fig. 3 6). This layer one Call Setup Request could be 

implemented as a modified Call or Session <S;etup Request that exists today in various 

: I 

protocols such as TCP/IP, ATM, X.25, etc. 1 All other packets could be borrowed from 
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standard protocol sets of the systems that the layer one devices are operating on, such 
as TCP/IP, ATM, X.25, etc 

Fig.43, Fig. 44, Fig.45, and Fig. 46 illustrate the signaling and message processes 
between the elements of the layer one network. Fig.43 shows the details of the layer 
5 one Call Setup Process throughout the layer one network. Fig. 44 shows the layer one 
Call TearDown Process throughout the layer one network. Fig.45 shows the layer one 
Switching Process throughout the layer one network. Fig. 46 shows the layer one Inter- 
Node Call Setup Process throughout the layer one network, for purposes such as 
emergency messages, timing synchronization, and administration. 

10 Fig. 47 shows the added efficiency of the "headerless" packet. In this 

embodiment, the layer one network originating node strips off the layer two and layer 
three source and destination addresses. It may also strip off any information that the 
terminating edge knows due to the Call Setup Process, which it could then reinsert as 
the packet exits the network. In this manner, the layer one packets through the 

1 5 network eliminate the inefficiencies of retransmitting this repetitive information. 
Fig.47 shows the traditional information packet with its various elements. The 
"headerless" packet is then shown with the layer two source and destination addresses 
removed by ihe originating edge node, such tiiai a is a smaller packet as u is layer one 
switched through the network. The packet is then shown with the layer two source 

20 and destination addresses reinserted by the terminating edge node as the layer one 

packet exits the system. Not shown, but part of the present invention is the ability to 
remove any part of the packet in any of the layers, including all of the headers, any 
repetitive information, or any information which the terminating edge knows which it 
could reinsert to replicate the packet as it exits the node. 
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Fig.48 uses a timing diagram to illustrate how scheduled layer one events might 
work in practice. In this example, layer one packet 3-1 has been scheduled to be sent 
through this layer one node at time ti, while layer one packet 1-2 has been scheduled 
to be sent through this layer one node at time t x . Prior to time t], the layer one event 
scheduler, using the black "Safety Zone" stops standard packets on input 3 and output 
1, and switches input 3 and output 1 to be directly connected to each other. At time ti 
±_ some marginal error less than the safety zone, layer one packet 3- Tenters input 3 
and gets "hardwire" routed directly through to output 1 with no more delay than the 
propagation delay. At the end of the safety zone time, the node converts input 3 and 
output 1 back into standard packet mode configuration. At time t x ., the node does the 
same thing for layer one packet 1-2, but this time it routes it from input 1 to output 2. 

Fig. 49 shows the same scenario, except that this time it shows how standard 
packets interact with the layer one packets. Shortly after time t 0 , standard packet 1 
gets shipped into Input 1. Since there is no contention, packet 1 gets store in input 
buffer 1, gets routed onto the standard packet, cell, or frame switch and then to output 
buffer 3 where it appears from output 3 a short time later. The same thing happens to 
standard packet 2 on input 2, except that the layer one controller detects a potential 
layer one collision with layer one packet 1-2 scheduled to be coming out of output 2 at 
that time. Because standard packet 2 would have overlapped the black safety zone, 
the controller holds packet 2 in the output buffer 2 until after layer one packet 1-2 has 
been transmitted. Standard packet 2 then is shipped out immediately following the 
black final safety zone for layer one packet 1-2. Standard packet 3 on input 3 has the 
same problem, but on an input buffer. Standard packet 3 arrives in time to be stored in 
the input buffer 3, but cannot be switched to the packet switch due to layer one packet 
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3-1's schedule arrival. As soon as layer one packet 3-1 's scheduled time is complete, 
including safety zones, standard packet 3 gets sent to the standard packet switch and 
emerges from output 4 sometime later. Standard packet 4 comes into input 2 and 
encounters no contention with layer one scheduled packets, so it is routed to the 
5 standard packet switch and emerges from output 1 a short while later. 

Fig. 50 shows some timing comparisons between different types of packet, cell, 
or frame switch technologies and layer one switching in one node or switch. As can be 
clearly seen, layer one switching is significantly faster than standard packet, cell, or 
frame switching, and is noticeably faster than layer two or layer three fast packet 

10 switching with high priority QOS/COS (quality of service, class of service). This is 
because in layer one there is no storing, no switching, and no possibilities of collision 
at any point in the node. 

Fig. 51 shows some timing comparisons between different types of packet, cell, 
or frame switch technologies and layer one switching over a full network of three 

15 nodes. Again, as can be clearly seen, layer one switching is significantly faster than 
standard packet, cell, or frame switching, and is noticeably faster than layer two or 
layer three fast packet switching with high priority QOS/COS (quality of service, class 
oi" service). AJihough there is some small propagation delay in the uansnussion and in 
the switch, the "hardwire" scheduled approach results in no storing, no switching, and 

20 no possibilities of collision at any point in the network. The result is fast, reliable, 

guaranteed, on-time, non-blocking, and non-delaying packet, cell, or frame switching 
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What is Claimed is: 

1 . A method for switching information through a plurality of network elements, 
comprising the steps of: 

associating a synchronization component with each of said plurality of network 
elements; 

synchronizing said synchronization component in each of said plurality of 
network elements; 

establishing a reservation schedule in each of said plurality of network elements; 
opening in each of said plurality of network elements a layer one connection at a 
time in accordance with said reservation schedule; 

transmitting information from a source network element to a destination network 
element through said layer one connection in each of said plurality of network 
elements in accordance with said reservation schedule; and 

closing said layer one connection in each of said plurality of network elements 
2. The method of claim 1 wherein said information comprises data selected from the 

group consisting of real-time data, high-priority data, and time sensitive data. 
3 The method of claim 1 wherein said information comprises data selected from the 
group consisting of cell-oriented, frame-oriented, and packet-oriented data. 

4 . The method of claim 1 wherein said synchronization component associated with 
each of said network elements is a clock. 

5 . The method of claim 4 wherein said clock associated with each of said network 
elements is synchronized in accordance with a master clock. 

6. The method of claim 5 wherein said master clock is the Global Positioning System. 
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7 . The method of claim 1 wherein each of said plurality of network elements is a store- 
and-forward network element. 

8 . The method of claim 1 further comprising the step of resetting said reservation 
schedule in at least two of said network elements. 

9. The method of claim 8 wherein the step of resetting said reservation schedule is 
initiated by a mid-destination network element. 

10. The method of claim 8 wherein the step of resetting said reservation schedule is 
initiated by a final destination network element. 

11. A network element for routing of data comprising: 

a store-and-forward switching component for transmission of store-and-forward 
data; 

bypass switching circuitry for transmission of data; 
a clock; 

a scheduler for scheduling transmissions of data in accordance with said bypass 
switching circuitry; and 

a controller for monitoring said clock and said scheduler, said controller adapted 
to activate said bypass switching circuitry in accordance with said scheduler and said 

clock. 

12. The network element of claim 1 1 wherein said store-and-forward switching 
component is integrated in said network element. 

I 3 . The network element of claim 1 1 wherein said store-and-forward switching 

component is independent of said network element. 
14. The network element of claim 1 1 wherein said bypass switching circuitry is overlaid 
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around said store-and-forward switching component. 
1 5 . The network element of claim 1 1 wherein said bypass switching circuitry comprises 
layer one switching circuitry. 

16. The network element of claim 1 1 further comprising buffers for holding said data in 
conjunction with said bypass switching circuitry. 

17. The network element of claim 1 1 wherein said data comprises headerless data. 
1 8 The network element of claim 1 1 wherein said data is selected from the group 

consisting of cell-oriented data, frame-oriented data, packet-oriented data, time 
sensitive data, and time insensitive data. 

19. The network element of claim 1 1 wherein said store-and-forward data comprises 
data selected from the group consisting of cell-oriented data, frame-oriented data, 
packet-oriented data, time sensitive data, and time insensitive data. 

20. A device for switching comprising: 

layer one switching circuitry; 
a clock; 

a scheduler for scheduling layer one switching circuitry; and 

a controller for monitoring said clock and said scheduler, said controller adapted 

to activate said layer one switching circuitry in accordance with said scheduler and 

said clock. 

2 1 . The device of claim 20 wherein said layer one switching circuitry is adapted for 
transmission of real-time data. 

22 . The device of claim 20 further comprising store-and-forward switching circuitry. 
23 . The device of claim 22 wherein said store-and-forward switching circuitry is 
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integrated in said network element. 
24. The device of claim 22 wherein said layer one switching circuitry is overlaid around 

said store-and-forward switching circuitry. 
2 5 . The device of claim 20 wherein said layer one switching circuitry, said clock, said 

scheduler, and said controller are associated with a network element. 

26. The device of claim 20 wherein said layer one switching circuitry, said clock, said 
scheduler, and said controller are associated with a LAN-attached device. 

27. The device of claim 20 wherein said layer one switching circuitry, said clock, said 
scheduler, and said controller are associated with an end-user device. 

28. The device of claim 20 further comprising buffers for holding information in 
conjunction with said layer one switching circuitry. 

29. A method for performing synchronized store-and-forward switching, comprising the 
steps of: 

establishing a first transmission path between a source and a departure router; 

sending from said source to said departure router a request for a time sensitive 
data transmission from said source to a receiver; 

locating a mid-destination router and a second transmission path from said 
departure router to said mid-desunation routei; 

locating a final destination router and a third transmission path from said mid- 
destination router to a final destination router; 

locating said receiver and a fourth transmission path from said final destination 
router to said receiver; 

negotiating a reservation schedule between said departure router, said mid- 
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destination router, and said final-destination router; 

transmitting time sensitive data from said source to said receiver in accordance 

with said reservation schedule, said first transmission path, said second transmission 

path, said third transmission path, and said fourth transmission path. 
3 0. The method of claim 29 further comprising the step of transmitting time sensitive 

data from said receiver to said source in accordance with said reservation schedule, 

said first transmission path, said second transmission path, said third transmission 

path, and said fourth transmission path. 
3 1 . The method of claim 29 wherein said first transmission path, said second 

transmission path, said third transmission path, and said fourth transmission path 

support bi-directional data transmissions. 
3 2 . The method of claim 29 further comprising the step of sending a teardown message 

to said departure router, said mid-destination router, and said final destination 

router. 

33 . The method of claim 32 wherein said source sends said teardown message to said 
departure router, said mid-destination router, and said final destination router. 

34. The method of claim 32 wherein said receiver sends said teardown message to said 
departure router, said mid-destination router, and said final destination router. 

3 5 . The method of claim 32 further comprising the step of releasing said reservation 
schedule upon receipt of said teardown message. 

3 6 The method of claim 29 wherein the step of negotiating a reservation schedule 
comprises the step of transmitting call setup messages between said departure 
router, said mid-destination router, and said final-destination router. 
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3 7 . The method of claim 29 wherein the step of transmitting time sensitive data 
comprises the steps of: 

removing a portion of data from said time sensitive data; and 
reinserting said portion of data in said time sensitive data. 
3 8 . The method of claim 37 wherein the step of removing a portion of data from said 
time sensitive data is performed by said departure router and the step of reinserting 
said portion of data in said time sensitive data is performed by said final destination 
router. 

3 9 . The method of claim 37 wherein said portion of data is a header for said time 
sensitive data. 

40. A system for routing information through a network of switches, comprising: 

a first network element adapted for communication in accordance with layer 
one switching; 

a second network element adapted for communication in accordance with 
layer one switching; 

a data source, said data source adapted for communication with said first 
network element; 

a data receiver, said data receiver adapted lor communication with said 
second network element; 

a plurality of network elements between said first network element and said 
second network element, said plurality of network elements adapted for 
communication in accordance with layer one switching; and 

a transmission path between said data source and said data receiver, said 
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transmission path adapted for transmission of data from said data source to said data 
receiver in accordance with layer one switching. 

4 1 . The system of claim 40 wherein said data source comprises a time sensitive data 
source. 

42 . The system of claim 40 wherein said data receiver comprises a time sensitive data 
receiver. 

43 . The system of claim 40 wherein said first network element and said second network 
element are adapted for layer one switching in accordance with a controller, a 
synchronization component, and a scheduling and execution component. 

44. The system of claim 43 wherein said synchronization component comprises a master 
clock. 

45 The system of claim 44 wherein said master clock is the Global Positioning System. 

46. The system of claim 40 wherein said plurality of network elements between said first 
network element and said second network element are adapted for layer one 
switching in accordance with a controller, a synchronization component, and a 
scheduling and execution component. 

47 . The system of claim 46 wherein said synchronization component comprises a master 
clock. 

48 . The system of claim 47 wherein said clock is the Global Positioning System. 

49. The system of claim 40 wherein said data comprises headerless data. 

50. The system of claim 40 wherein said data comprises data selected from the group 
consisting of cell-oriented, frame-oriented, and packet-oriented data. 

5 1 . The system of claim 40 further comprising buffers in each of said network elements 
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for holding data in conjunction with layer one switching. 
5 2 . The system of claim 40 wherein said network of switches comprises switches 

selected from the group consisting of cell switches, frame switches, and packet 

switches. 

53 . The system of claim 40 wherein each of said network elements along said 
transmission path simultaneously implements layer one switching. 

54 . The system of claim 40 whereby data from said data source is routed directly 
through said first network element, said plurality of network elements, and said 
second network element to said data receiver. 
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